[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 14:16:30.626420 19136 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.176.62:46653
I20240502 14:16:30.628532 19136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 14:16:30.630172 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:16:30.644701 19144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:16:30.644812 19142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:16:30.644892 19141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:16:30.645715 19136 server_base.cc:1034] running on GCE node
I20240502 14:16:30.646826 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:16:30.647017 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:16:30.647100 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659390647081 us; error 0 us; skew 500 ppm
I20240502 14:16:30.647490 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:16:30.656677 19136 webserver.cc:460] Webserver started at http://127.18.176.62:42047/ using document root <none> and password file <none>
I20240502 14:16:30.658161 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:16:30.658337 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:16:30.658843 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:16:30.663162 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/master-0-root/instance:
uuid: "4b969661996245998bd9398114165047"
format_stamp: "Formatted at 2024-05-02 14:16:30 on dist-test-slave-02q2"
I20240502 14:16:30.671944 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20240502 14:16:30.676681 19149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.678745 19136 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20240502 14:16:30.679018 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/master-0-root
uuid: "4b969661996245998bd9398114165047"
format_stamp: "Formatted at 2024-05-02 14:16:30 on dist-test-slave-02q2"
I20240502 14:16:30.679257 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:16:30.697360 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:16:30.698489 19136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 14:16:30.698915 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:16:30.723908 19200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.62:46653 every 8 connection(s)
I20240502 14:16:30.723908 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.62:46653
I20240502 14:16:30.729722 19201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:30.744913 19201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047: Bootstrap starting.
I20240502 14:16:30.749491 19201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:30.751109 19201 log.cc:824] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047: Log is configured to *not* fsync() on all Append() calls
I20240502 14:16:30.754715 19201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047: No bootstrap required, opened a new log
I20240502 14:16:30.763057 19201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b969661996245998bd9398114165047" member_type: VOTER }
I20240502 14:16:30.763494 19201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:30.763588 19201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b969661996245998bd9398114165047, State: Initialized, Role: FOLLOWER
I20240502 14:16:30.764439 19201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b969661996245998bd9398114165047" member_type: VOTER }
I20240502 14:16:30.764705 19201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 14:16:30.764827 19201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 14:16:30.765002 19201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:30.767458 19201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b969661996245998bd9398114165047" member_type: VOTER }
I20240502 14:16:30.768151 19201 leader_election.cc:302] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b969661996245998bd9398114165047; no voters:
I20240502 14:16:30.768931 19201 leader_election.cc:288] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 14:16:30.769125 19204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:30.769865 19204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 1 LEADER]: Becoming Leader. State: Replica: 4b969661996245998bd9398114165047, State: Running, Role: LEADER
I20240502 14:16:30.770640 19204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b969661996245998bd9398114165047" member_type: VOTER }
I20240502 14:16:30.771487 19201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 14:16:30.774137 19206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b969661996245998bd9398114165047. Latest consensus state: current_term: 1 leader_uuid: "4b969661996245998bd9398114165047" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b969661996245998bd9398114165047" member_type: VOTER } }
I20240502 14:16:30.774154 19205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b969661996245998bd9398114165047" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b969661996245998bd9398114165047" member_type: VOTER } }
I20240502 14:16:30.774618 19206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [sys.catalog]: This master's current role is: LEADER
I20240502 14:16:30.774618 19205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [sys.catalog]: This master's current role is: LEADER
I20240502 14:16:30.777036 19212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 14:16:30.783479 19212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 14:16:30.784343 19136 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 14:16:30.797823 19212 catalog_manager.cc:1347] Generated new cluster ID: 26e69b4ba6014b84aaa39d121a34f4e9
I20240502 14:16:30.798038 19212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 14:16:30.815490 19212 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 14:16:30.817785 19212 catalog_manager.cc:1504] Loading token signing keys...
I20240502 14:16:30.833153 19212 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047: Generated new TSK 0
I20240502 14:16:30.834276 19212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 14:16:30.850440 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:16:30.855878 19224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:16:30.855727 19223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:16:30.857779 19136 server_base.cc:1034] running on GCE node
W20240502 14:16:30.858305 19226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:16:30.858827 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:16:30.858965 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:16:30.859048 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659390859021 us; error 0 us; skew 500 ppm
I20240502 14:16:30.859310 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:16:30.861128 19136 webserver.cc:460] Webserver started at http://127.18.176.1:39939/ using document root <none> and password file <none>
I20240502 14:16:30.861542 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:16:30.861657 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:16:30.861863 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:16:30.863004 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-0-root/instance:
uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
format_stamp: "Formatted at 2024-05-02 14:16:30 on dist-test-slave-02q2"
I20240502 14:16:30.867635 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 14:16:30.870646 19231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.871546 19136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 14:16:30.871783 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-0-root
uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
format_stamp: "Formatted at 2024-05-02 14:16:30 on dist-test-slave-02q2"
I20240502 14:16:30.871973 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:16:30.884686 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:16:30.885836 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:16:30.887164 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:16:30.889420 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:16:30.889614 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.889762 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:16:30.889864 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.912797 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.1:43241
I20240502 14:16:30.912868 19293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.1:43241 every 8 connection(s)
I20240502 14:16:30.915436 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:16:30.931978 19296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:16:30.938508 19299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:16:30.945187 19136 server_base.cc:1034] running on GCE node
W20240502 14:16:30.946734 19301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:16:30.947837 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:16:30.947953 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:16:30.948057 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659390947999 us; error 0 us; skew 500 ppm
I20240502 14:16:30.948276 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:16:30.950248 19136 webserver.cc:460] Webserver started at http://127.18.176.2:33221/ using document root <none> and password file <none>
I20240502 14:16:30.950655 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:16:30.950847 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:16:30.950912 19294 heartbeater.cc:347] Connected to a master server at 127.18.176.62:46653
I20240502 14:16:30.951061 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:16:30.951319 19294 heartbeater.cc:464] Registering TS with master...
I20240502 14:16:30.952064 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-1-root/instance:
uuid: "11c1d682e71e4bc4995b896158f9d0c5"
format_stamp: "Formatted at 2024-05-02 14:16:30 on dist-test-slave-02q2"
I20240502 14:16:30.952404 19294 heartbeater.cc:511] Master 127.18.176.62:46653 requested a full tablet report, sending...
I20240502 14:16:30.955291 19166 ts_manager.cc:194] Registered new tserver with Master: b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241)
I20240502 14:16:30.957263 19166 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56222
I20240502 14:16:30.959230 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20240502 14:16:30.961598 19306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.962076 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.001s
I20240502 14:16:30.962226 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-1-root
uuid: "11c1d682e71e4bc4995b896158f9d0c5"
format_stamp: "Formatted at 2024-05-02 14:16:30 on dist-test-slave-02q2"
I20240502 14:16:30.962394 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:16:30.972755 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:16:30.973752 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:16:30.974555 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:16:30.975827 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:16:30.975924 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.976068 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:16:30.976135 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:30.999109 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.2:36167
I20240502 14:16:30.999125 19368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.2:36167 every 8 connection(s)
I20240502 14:16:31.001495 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:16:31.005561 19372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:16:31.008128 19375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:16:31.008457 19373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:16:31.014621 19369 heartbeater.cc:347] Connected to a master server at 127.18.176.62:46653
I20240502 14:16:31.014847 19369 heartbeater.cc:464] Registering TS with master...
I20240502 14:16:31.015406 19369 heartbeater.cc:511] Master 127.18.176.62:46653 requested a full tablet report, sending...
I20240502 14:16:31.016144 19136 server_base.cc:1034] running on GCE node
I20240502 14:16:31.016570 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20240502 14:16:31.016706 19166 ts_manager.cc:194] Registered new tserver with Master: 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
W20240502 14:16:31.016757 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:16:31.016849 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659391016821 us; error 0 us; skew 500 ppm
I20240502 14:16:31.017103 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:16:31.017882 19166 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56230
I20240502 14:16:31.019192 19136 webserver.cc:460] Webserver started at http://127.18.176.3:43649/ using document root <none> and password file <none>
I20240502 14:16:31.019601 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:16:31.019718 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:16:31.019912 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:16:31.020999 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-2-root/instance:
uuid: "b9e2f86110a246a6987ec90202a3b2d4"
format_stamp: "Formatted at 2024-05-02 14:16:31 on dist-test-slave-02q2"
I20240502 14:16:31.025641 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20240502 14:16:31.029062 19380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:31.029724 19136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 14:16:31.029932 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-2-root
uuid: "b9e2f86110a246a6987ec90202a3b2d4"
format_stamp: "Formatted at 2024-05-02 14:16:31 on dist-test-slave-02q2"
I20240502 14:16:31.030154 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714659390546060-19136-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:16:31.045755 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:16:31.046909 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:16:31.048151 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:16:31.049974 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:16:31.050134 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:31.050280 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:16:31.050400 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:16:31.074597 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.3:38477
I20240502 14:16:31.074637 19442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.3:38477 every 8 connection(s)
I20240502 14:16:31.085801 19443 heartbeater.cc:347] Connected to a master server at 127.18.176.62:46653
I20240502 14:16:31.086025 19443 heartbeater.cc:464] Registering TS with master...
I20240502 14:16:31.086705 19443 heartbeater.cc:511] Master 127.18.176.62:46653 requested a full tablet report, sending...
I20240502 14:16:31.087977 19166 ts_manager.cc:194] Registered new tserver with Master: b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.088495 19136 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012210996s
I20240502 14:16:31.089267 19166 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56244
I20240502 14:16:31.090799 19136 test_util.cc:268] Using random seed: 1072345152
I20240502 14:16:31.120270 19166 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56260:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 14:16:31.123404 19166 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 14:16:31.171715 19408 tablet_service.cc:1467] Processing CreateTablet for tablet d6fcade6e81649b5beffddfcf6fe11c9 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 14:16:31.172976 19408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6fcade6e81649b5beffddfcf6fe11c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.176412 19334 tablet_service.cc:1467] Processing CreateTablet for tablet d6fcade6e81649b5beffddfcf6fe11c9 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 14:16:31.176527 19332 tablet_service.cc:1467] Processing CreateTablet for tablet abbac7ba4c9f4d819d8c9a62850e4910 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 14:16:31.177587 19331 tablet_service.cc:1467] Processing CreateTablet for tablet b030e44b43a748f6b366b197e2fd1b8e (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 14:16:31.178952 19334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6fcade6e81649b5beffddfcf6fe11c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.181228 19332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbac7ba4c9f4d819d8c9a62850e4910. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.182263 19328 tablet_service.cc:1467] Processing CreateTablet for tablet 0e5c26e9ea0e4f97ae900e409c26574a (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 14:16:31.181648 19333 tablet_service.cc:1467] Processing CreateTablet for tablet 183dd83313904e87badf41634b333aeb (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 14:16:31.184688 19326 tablet_service.cc:1467] Processing CreateTablet for tablet 6a98858b66b342be9914a79d2ed8c057 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 14:16:31.186247 19331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b030e44b43a748f6b366b197e2fd1b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.185039 19329 tablet_service.cc:1467] Processing CreateTablet for tablet b991e80285104823aa92c3a0d82254b6 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 14:16:31.185128 19327 tablet_service.cc:1467] Processing CreateTablet for tablet 51bc2a3486284529a2e33ca12f9b70e4 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 14:16:31.186831 19330 tablet_service.cc:1467] Processing CreateTablet for tablet 2d44409afb8c40ce820136fa8863ea0c (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 14:16:31.189134 19407 tablet_service.cc:1467] Processing CreateTablet for tablet 183dd83313904e87badf41634b333aeb (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 14:16:31.193470 19328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e5c26e9ea0e4f97ae900e409c26574a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.190605 19405 tablet_service.cc:1467] Processing CreateTablet for tablet b030e44b43a748f6b366b197e2fd1b8e (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 14:16:31.190631 19406 tablet_service.cc:1467] Processing CreateTablet for tablet abbac7ba4c9f4d819d8c9a62850e4910 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 14:16:31.196913 19333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183dd83313904e87badf41634b333aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.195945 19404 tablet_service.cc:1467] Processing CreateTablet for tablet 2d44409afb8c40ce820136fa8863ea0c (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 14:16:31.199455 19403 tablet_service.cc:1467] Processing CreateTablet for tablet b991e80285104823aa92c3a0d82254b6 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 14:16:31.199487 19401 tablet_service.cc:1467] Processing CreateTablet for tablet 51bc2a3486284529a2e33ca12f9b70e4 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 14:16:31.202605 19407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183dd83313904e87badf41634b333aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.202807 19329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b991e80285104823aa92c3a0d82254b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.204550 19402 tablet_service.cc:1467] Processing CreateTablet for tablet 0e5c26e9ea0e4f97ae900e409c26574a (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 14:16:31.207453 19401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51bc2a3486284529a2e33ca12f9b70e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.209633 19330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d44409afb8c40ce820136fa8863ea0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.209486 19400 tablet_service.cc:1467] Processing CreateTablet for tablet 6a98858b66b342be9914a79d2ed8c057 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 14:16:31.207132 19257 tablet_service.cc:1467] Processing CreateTablet for tablet abbac7ba4c9f4d819d8c9a62850e4910 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 14:16:31.211468 19252 tablet_service.cc:1467] Processing CreateTablet for tablet 51bc2a3486284529a2e33ca12f9b70e4 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 14:16:31.215889 19327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51bc2a3486284529a2e33ca12f9b70e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.211444 19258 tablet_service.cc:1467] Processing CreateTablet for tablet 183dd83313904e87badf41634b333aeb (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 14:16:31.216655 19403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b991e80285104823aa92c3a0d82254b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.213642 19259 tablet_service.cc:1467] Processing CreateTablet for tablet d6fcade6e81649b5beffddfcf6fe11c9 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 14:16:31.216347 19251 tablet_service.cc:1467] Processing CreateTablet for tablet 6a98858b66b342be9914a79d2ed8c057 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 14:16:31.220813 19326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a98858b66b342be9914a79d2ed8c057. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.217113 19256 tablet_service.cc:1467] Processing CreateTablet for tablet b030e44b43a748f6b366b197e2fd1b8e (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 14:16:31.219333 19254 tablet_service.cc:1467] Processing CreateTablet for tablet b991e80285104823aa92c3a0d82254b6 (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 14:16:31.220871 19255 tablet_service.cc:1467] Processing CreateTablet for tablet 2d44409afb8c40ce820136fa8863ea0c (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 14:16:31.223292 19252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51bc2a3486284529a2e33ca12f9b70e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.223529 19400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a98858b66b342be9914a79d2ed8c057. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.224525 19402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e5c26e9ea0e4f97ae900e409c26574a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.221778 19253 tablet_service.cc:1467] Processing CreateTablet for tablet 0e5c26e9ea0e4f97ae900e409c26574a (DEFAULT_TABLE table=test-workload [id=5fda150fc93b4cb487b2f6661bba1478]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 14:16:31.226451 19405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b030e44b43a748f6b366b197e2fd1b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.229877 19257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbac7ba4c9f4d819d8c9a62850e4910. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.236483 19258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183dd83313904e87badf41634b333aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.237659 19404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d44409afb8c40ce820136fa8863ea0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.244783 19254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b991e80285104823aa92c3a0d82254b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.247220 19253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e5c26e9ea0e4f97ae900e409c26574a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.248406 19406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbac7ba4c9f4d819d8c9a62850e4910. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.253190 19256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b030e44b43a748f6b366b197e2fd1b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.260409 19259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6fcade6e81649b5beffddfcf6fe11c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.264482 19251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a98858b66b342be9914a79d2ed8c057. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.270005 19255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d44409afb8c40ce820136fa8863ea0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:16:31.280858 19458 tablet_bootstrap.cc:492] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.321082 19459 tablet_bootstrap.cc:492] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.365790 19458 tablet_bootstrap.cc:654] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.366225 19460 tablet_bootstrap.cc:492] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.375038 19459 tablet_bootstrap.cc:654] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.380266 19460 tablet_bootstrap.cc:654] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.383378 19459 tablet_bootstrap.cc:492] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.383672 19459 ts_tablet_manager.cc:1367] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.007s
I20240502 14:16:31.383999 19460 tablet_bootstrap.cc:492] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.384184 19460 ts_tablet_manager.cc:1367] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20240502 14:16:31.384855 19459 raft_consensus.cc:348] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.385248 19458 tablet_bootstrap.cc:492] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.385254 19459 raft_consensus.cc:374] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.385035 19460 raft_consensus.cc:348] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.385416 19459 raft_consensus.cc:729] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.385484 19460 raft_consensus.cc:374] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.385596 19460 raft_consensus.cc:729] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.385424 19458 ts_tablet_manager.cc:1367] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.111s user 0.007s sys 0.005s
I20240502 14:16:31.385891 19459 consensus_queue.cc:260] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.386942 19459 ts_tablet_manager.cc:1398] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240502 14:16:31.387060 19458 raft_consensus.cc:348] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.387291 19458 raft_consensus.cc:374] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.387346 19369 heartbeater.cc:503] Master 127.18.176.62:46653 was elected leader, sending a full tablet report...
I20240502 14:16:31.387416 19458 raft_consensus.cc:729] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.387455 19459 tablet_bootstrap.cc:492] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.387814 19458 consensus_queue.cc:260] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.385862 19460 consensus_queue.cc:260] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.389716 19459 tablet_bootstrap.cc:654] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.399174 19443 heartbeater.cc:503] Master 127.18.176.62:46653 was elected leader, sending a full tablet report...
I20240502 14:16:31.399334 19458 ts_tablet_manager.cc:1398] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.013s user 0.004s sys 0.003s
I20240502 14:16:31.399796 19458 tablet_bootstrap.cc:492] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.404342 19458 tablet_bootstrap.cc:654] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.407327 19460 ts_tablet_manager.cc:1398] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.023s user 0.007s sys 0.005s
I20240502 14:16:31.407922 19294 heartbeater.cc:503] Master 127.18.176.62:46653 was elected leader, sending a full tablet report...
I20240502 14:16:31.407927 19460 tablet_bootstrap.cc:492] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.410153 19459 tablet_bootstrap.cc:492] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.411747 19459 ts_tablet_manager.cc:1367] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.007s
I20240502 14:16:31.412919 19459 raft_consensus.cc:348] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.413192 19459 raft_consensus.cc:374] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.413295 19459 raft_consensus.cc:729] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.413623 19459 consensus_queue.cc:260] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.414517 19459 ts_tablet_manager.cc:1398] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:16:31.414983 19459 tablet_bootstrap.cc:492] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
W20240502 14:16:31.415061 19295 tablet.cc:2369] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 14:16:31.420843 19459 tablet_bootstrap.cc:654] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.420895 19460 tablet_bootstrap.cc:654] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.423460 19459 tablet_bootstrap.cc:492] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.423674 19459 ts_tablet_manager.cc:1367] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240502 14:16:31.424511 19459 raft_consensus.cc:348] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.424722 19459 raft_consensus.cc:374] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.424826 19459 raft_consensus.cc:729] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.425123 19459 consensus_queue.cc:260] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.426820 19459 ts_tablet_manager.cc:1398] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:16:31.427211 19459 tablet_bootstrap.cc:492] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.429417 19459 tablet_bootstrap.cc:654] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.429749 19460 tablet_bootstrap.cc:492] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.430160 19460 ts_tablet_manager.cc:1367] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.004s
I20240502 14:16:31.431356 19460 raft_consensus.cc:348] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.431663 19460 raft_consensus.cc:374] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.431775 19460 raft_consensus.cc:729] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.431979 19458 tablet_bootstrap.cc:492] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.432184 19458 ts_tablet_manager.cc:1367] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.005s
I20240502 14:16:31.432080 19460 consensus_queue.cc:260] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.432848 19460 ts_tablet_manager.cc:1398] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:16:31.433153 19458 raft_consensus.cc:348] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.433341 19460 tablet_bootstrap.cc:492] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.433429 19458 raft_consensus.cc:374] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.433530 19458 raft_consensus.cc:729] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.433810 19458 consensus_queue.cc:260] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.434422 19458 ts_tablet_manager.cc:1398] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:16:31.435192 19458 tablet_bootstrap.cc:492] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.436122 19460 tablet_bootstrap.cc:654] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.437242 19458 tablet_bootstrap.cc:654] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.444113 19459 tablet_bootstrap.cc:492] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.444362 19459 ts_tablet_manager.cc:1367] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20240502 14:16:31.445170 19459 raft_consensus.cc:348] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.445420 19459 raft_consensus.cc:374] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.445535 19459 raft_consensus.cc:729] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.445885 19459 consensus_queue.cc:260] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.446314 19460 tablet_bootstrap.cc:492] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.446513 19460 ts_tablet_manager.cc:1367] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.010s
I20240502 14:16:31.446842 19459 ts_tablet_manager.cc:1398] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:16:31.447233 19459 tablet_bootstrap.cc:492] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.447541 19460 raft_consensus.cc:348] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.447793 19460 raft_consensus.cc:374] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.447894 19460 raft_consensus.cc:729] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.448163 19460 consensus_queue.cc:260] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.448911 19460 ts_tablet_manager.cc:1398] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:16:31.449255 19460 tablet_bootstrap.cc:492] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.449602 19458 tablet_bootstrap.cc:492] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.449769 19458 ts_tablet_manager.cc:1367] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.006s
I20240502 14:16:31.450774 19458 raft_consensus.cc:348] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.451037 19458 raft_consensus.cc:374] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.451143 19458 raft_consensus.cc:729] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.451539 19460 tablet_bootstrap.cc:654] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.451460 19458 consensus_queue.cc:260] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.452121 19458 ts_tablet_manager.cc:1398] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:16:31.452801 19459 tablet_bootstrap.cc:654] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.454169 19458 tablet_bootstrap.cc:492] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.456264 19458 tablet_bootstrap.cc:654] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.460568 19460 tablet_bootstrap.cc:492] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.460835 19460 ts_tablet_manager.cc:1367] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20240502 14:16:31.462155 19460 raft_consensus.cc:348] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.462491 19460 raft_consensus.cc:374] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.462630 19460 raft_consensus.cc:729] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.462976 19460 consensus_queue.cc:260] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.463917 19460 ts_tablet_manager.cc:1398] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:16:31.464388 19460 tablet_bootstrap.cc:492] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.466895 19460 tablet_bootstrap.cc:654] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.469653 19460 tablet_bootstrap.cc:492] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.469893 19460 ts_tablet_manager.cc:1367] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20240502 14:16:31.471112 19460 raft_consensus.cc:348] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.471599 19460 raft_consensus.cc:374] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.471783 19460 raft_consensus.cc:729] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.472328 19458 tablet_bootstrap.cc:492] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.472187 19460 consensus_queue.cc:260] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.472568 19459 tablet_bootstrap.cc:492] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.472608 19458 ts_tablet_manager.cc:1367] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.005s
I20240502 14:16:31.472751 19459 ts_tablet_manager.cc:1367] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.002s
I20240502 14:16:31.473688 19458 raft_consensus.cc:348] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.473975 19458 raft_consensus.cc:374] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.473848 19459 raft_consensus.cc:348] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.474090 19458 raft_consensus.cc:729] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.474166 19459 raft_consensus.cc:374] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.474272 19459 raft_consensus.cc:729] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.474478 19458 consensus_queue.cc:260] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.474690 19459 consensus_queue.cc:260] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.475620 19459 ts_tablet_manager.cc:1398] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:16:31.475992 19459 tablet_bootstrap.cc:492] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.476449 19458 ts_tablet_manager.cc:1398] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:16:31.476812 19458 tablet_bootstrap.cc:492] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.478328 19459 tablet_bootstrap.cc:654] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.480895 19460 ts_tablet_manager.cc:1398] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20240502 14:16:31.481402 19460 tablet_bootstrap.cc:492] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.484995 19460 tablet_bootstrap.cc:654] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.485255 19458 tablet_bootstrap.cc:654] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.485654 19459 tablet_bootstrap.cc:492] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.485925 19459 ts_tablet_manager.cc:1367] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20240502 14:16:31.486992 19459 raft_consensus.cc:348] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.487370 19459 raft_consensus.cc:374] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.487531 19459 raft_consensus.cc:729] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.487951 19459 consensus_queue.cc:260] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.488909 19459 ts_tablet_manager.cc:1398] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:16:31.489414 19459 tablet_bootstrap.cc:492] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.492019 19459 tablet_bootstrap.cc:654] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.497046 19460 tablet_bootstrap.cc:492] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.497370 19460 ts_tablet_manager.cc:1367] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.014s
I20240502 14:16:31.497542 19458 tablet_bootstrap.cc:492] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.497753 19458 ts_tablet_manager.cc:1367] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20240502 14:16:31.497923 19459 tablet_bootstrap.cc:492] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.498133 19459 ts_tablet_manager.cc:1367] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20240502 14:16:31.498713 19460 raft_consensus.cc:348] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.498744 19458 raft_consensus.cc:348] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.499135 19458 raft_consensus.cc:374] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.499058 19459 raft_consensus.cc:348] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.499286 19458 raft_consensus.cc:729] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.499282 19459 raft_consensus.cc:374] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.499466 19459 raft_consensus.cc:729] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.499709 19459 consensus_queue.cc:260] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.499714 19458 consensus_queue.cc:260] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.500283 19459 ts_tablet_manager.cc:1398] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:16:31.500634 19459 tablet_bootstrap.cc:492] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.502372 19459 tablet_bootstrap.cc:654] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.499197 19460 raft_consensus.cc:374] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.502781 19460 raft_consensus.cc:729] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.503207 19460 consensus_queue.cc:260] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.504109 19460 ts_tablet_manager.cc:1398] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240502 14:16:31.504652 19460 tablet_bootstrap.cc:492] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.507218 19460 tablet_bootstrap.cc:654] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.516055 19458 ts_tablet_manager.cc:1398] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20240502 14:16:31.516144 19459 tablet_bootstrap.cc:492] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.516374 19459 ts_tablet_manager.cc:1367] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.006s
I20240502 14:16:31.517382 19465 raft_consensus.cc:482] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.517431 19459 raft_consensus.cc:348] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.517736 19459 raft_consensus.cc:374] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.517601 19465 raft_consensus.cc:504] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.517834 19459 raft_consensus.cc:729] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.518191 19459 consensus_queue.cc:260] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.518467 19460 tablet_bootstrap.cc:492] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.518780 19460 ts_tablet_manager.cc:1367] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20240502 14:16:31.519026 19459 ts_tablet_manager.cc:1398] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20240502 14:16:31.519384 19459 tablet_bootstrap.cc:492] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: Bootstrap starting.
I20240502 14:16:31.519914 19465 leader_election.cc:288] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241)
I20240502 14:16:31.522240 19459 tablet_bootstrap.cc:654] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.524363 19460 raft_consensus.cc:348] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.525391 19460 raft_consensus.cc:374] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.525875 19460 raft_consensus.cc:729] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.525399 19458 tablet_bootstrap.cc:492] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.526337 19460 consensus_queue.cc:260] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.527390 19460 ts_tablet_manager.cc:1398] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240502 14:16:31.527873 19460 tablet_bootstrap.cc:492] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.530339 19460 tablet_bootstrap.cc:654] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.530827 19458 tablet_bootstrap.cc:654] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.531718 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.533017 19344 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 0.
I20240502 14:16:31.535398 19464 raft_consensus.cc:482] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.536985 19381 leader_election.cc:302] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.536118 19464 raft_consensus.cc:504] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.539502 19464 leader_election.cc:288] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.540091 19465 raft_consensus.cc:2781] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.543531 19465 raft_consensus.cc:482] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.543828 19465 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.554188 19459 tablet_bootstrap.cc:492] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: No bootstrap required, opened a new log
I20240502 14:16:31.554457 19459 ts_tablet_manager.cc:1367] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.009s
I20240502 14:16:31.556908 19459 raft_consensus.cc:348] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.557241 19459 raft_consensus.cc:374] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.557549 19459 raft_consensus.cc:729] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.559551 19459 consensus_queue.cc:260] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.562081 19458 tablet_bootstrap.cc:492] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.562558 19460 tablet_bootstrap.cc:492] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.562820 19458 ts_tablet_manager.cc:1367] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.005s
I20240502 14:16:31.563272 19459 ts_tablet_manager.cc:1398] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20240502 14:16:31.567241 19460 ts_tablet_manager.cc:1367] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.035s user 0.017s sys 0.010s
I20240502 14:16:31.568295 19458 raft_consensus.cc:348] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.569188 19464 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.569226 19458 raft_consensus.cc:374] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.570086 19464 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.570832 19458 raft_consensus.cc:729] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.570920 19464 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.572232 19465 raft_consensus.cc:504] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.573063 19458 consensus_queue.cc:260] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.575539 19460 raft_consensus.cc:348] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.576267 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.576674 19344 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.576334 19465 leader_election.cc:288] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241)
I20240502 14:16:31.576236 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:31.579159 19460 raft_consensus.cc:374] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.579324 19460 raft_consensus.cc:729] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.579892 19269 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 0.
I20240502 14:16:31.579876 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:31.581492 19268 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.579910 19458 ts_tablet_manager.cc:1398] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.016s user 0.003s sys 0.002s
I20240502 14:16:31.583082 19344 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 1.
I20240502 14:16:31.579900 19460 consensus_queue.cc:260] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.583832 19460 ts_tablet_manager.cc:1398] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.016s user 0.000s sys 0.003s
I20240502 14:16:31.584121 19381 leader_election.cc:302] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.584229 19460 tablet_bootstrap.cc:492] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05: Bootstrap starting.
I20240502 14:16:31.584271 19458 tablet_bootstrap.cc:492] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.586387 19458 tablet_bootstrap.cc:654] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.586391 19460 tablet_bootstrap.cc:654] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.586719 19491 raft_consensus.cc:2781] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.591109 19466 raft_consensus.cc:482] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.591464 19494 raft_consensus.cc:482] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.591384 19466 raft_consensus.cc:504] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.591625 19494 raft_consensus.cc:504] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.592748 19466 leader_election.cc:288] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.593127 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:31.593403 19269 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 0.
I20240502 14:16:31.594213 19381 leader_election.cc:302] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.594761 19491 raft_consensus.cc:686] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:31.595247 19491 consensus_queue.cc:237] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.596338 19268 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 1.
I20240502 14:16:31.598978 19465 raft_consensus.cc:2781] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.599577 19465 raft_consensus.cc:482] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.599908 19465 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.600301 19466 raft_consensus.cc:482] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.600642 19466 raft_consensus.cc:504] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.601490 19466 leader_election.cc:288] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.604292 19494 leader_election.cc:288] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:31.605159 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.613888 19344 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 0.
I20240502 14:16:31.605525 19165 catalog_manager.cc:5484] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 1 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:31.616606 19418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
W20240502 14:16:31.626950 19310 leader_election.cc:341] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.626860 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.628439 19466 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240502 14:16:31.630643 19310 leader_election.cc:341] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.629988 19466 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.632750 19460 tablet_bootstrap.cc:492] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05: No bootstrap required, opened a new log
I20240502 14:16:31.633749 19460 ts_tablet_manager.cc:1367] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent bootstrapping tablet: real 0.049s user 0.016s sys 0.024s
I20240502 14:16:31.635596 19466 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.637073 19458 tablet_bootstrap.cc:492] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.637081 19460 raft_consensus.cc:348] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.637293 19458 ts_tablet_manager.cc:1367] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.054s user 0.019s sys 0.011s
I20240502 14:16:31.637416 19460 raft_consensus.cc:374] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.637909 19460 raft_consensus.cc:729] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.638780 19460 consensus_queue.cc:260] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.639605 19465 raft_consensus.cc:504] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.641997 19460 ts_tablet_manager.cc:1398] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 14:16:31.642359 19466 raft_consensus.cc:482] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.642727 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.642891 19458 raft_consensus.cc:348] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.643173 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:31.643493 19344 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.643458 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.643550 19418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.644161 19465 leader_election.cc:288] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:31.644232 19417 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.645016 19458 raft_consensus.cc:374] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.645259 19268 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.645900 19418 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.646723 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.648159 19235 leader_election.cc:302] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.648284 19466 raft_consensus.cc:504] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.650504 19466 leader_election.cc:288] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.654506 19466 raft_consensus.cc:2781] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.657189 19458 raft_consensus.cc:729] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.657737 19344 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 1.
I20240502 14:16:31.658466 19381 leader_election.cc:302] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.658877 19465 raft_consensus.cc:2781] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.658874 19466 raft_consensus.cc:482] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.660094 19466 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.660322 19465 raft_consensus.cc:686] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:31.659811 19458 consensus_queue.cc:260] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.661499 19458 ts_tablet_manager.cc:1398] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.024s user 0.000s sys 0.003s
I20240502 14:16:31.662005 19465 consensus_queue.cc:237] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.663053 19268 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 1.
I20240502 14:16:31.664788 19458 tablet_bootstrap.cc:492] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.668733 19235 leader_election.cc:302] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.669622 19344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.670631 19344 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.671849 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.672706 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.673204 19417 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.673593 19500 raft_consensus.cc:2781] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.674005 19341 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.674010 19342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.674314 19342 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
W20240502 14:16:31.674681 19235 leader_election.cc:341] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.675093 19343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.676904 19466 raft_consensus.cc:504] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.677073 19343 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.678380 19464 raft_consensus.cc:482] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.678345 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:31.678627 19464 raft_consensus.cc:504] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.679354 19464 leader_election.cc:288] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.679893 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:31.680133 19269 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 0.
I20240502 14:16:31.680379 19232 leader_election.cc:302] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters:
I20240502 14:16:31.681126 19268 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 0.
I20240502 14:16:31.681864 19418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.682148 19418 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.682073 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
W20240502 14:16:31.683274 19310 leader_election.cc:341] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.683362 19343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.683429 19307 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters: b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.683601 19343 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.681401 19466 leader_election.cc:288] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.684099 19464 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.686956 19464 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.687273 19464 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.686935 19466 raft_consensus.cc:2781] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.687749 19307 leader_election.cc:302] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters: b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.678136 19500 raft_consensus.cc:482] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.699319 19466 raft_consensus.cc:482] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.699355 19500 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.700846 19466 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.699429 19165 catalog_manager.cc:5484] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 1 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:31.704030 19502 raft_consensus.cc:482] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.704752 19458 tablet_bootstrap.cc:654] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.705129 19232 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters: b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.705807 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:31.711099 19418 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.711939 19235 leader_election.cc:302] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.713014 19343 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.712970 19504 raft_consensus.cc:2781] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.714969 19466 raft_consensus.cc:504] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.719470 19503 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.719332 19504 raft_consensus.cc:482] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.708051 19502 raft_consensus.cc:504] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.724169 19466 leader_election.cc:288] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.724108 19343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.724756 19268 raft_consensus.cc:2454] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 0.
I20240502 14:16:31.721407 19503 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.725890 19464 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.726344 19307 leader_election.cc:302] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters: b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.726670 19343 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.727747 19503 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.727973 19466 raft_consensus.cc:2781] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.728814 19466 raft_consensus.cc:686] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:31.729341 19466 consensus_queue.cc:237] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.735905 19504 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.737007 19464 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.738021 19464 raft_consensus.cc:2781] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.738188 19464 raft_consensus.cc:482] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.738317 19464 raft_consensus.cc:3037] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.740195 19500 raft_consensus.cc:504] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.741639 19342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.741680 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:31.742194 19418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
W20240502 14:16:31.744189 19310 leader_election.cc:341] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.743969 19502 leader_election.cc:288] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.744474 19466 raft_consensus.cc:482] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:31.744899 19418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.745747 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.748373 19500 leader_election.cc:288] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.749641 19341 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.750025 19418 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.747941 19165 catalog_manager.cc:5484] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 1 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:31.750187 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.751564 19464 raft_consensus.cc:504] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.754488 19342 raft_consensus.cc:2379] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b56ee61e0083428fa6e4a23dd5cc3c05 in current term 1: Already voted for candidate 11c1d682e71e4bc4995b896158f9d0c5 in this term.
I20240502 14:16:31.750926 19416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.755141 19416 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.755682 19466 raft_consensus.cc:504] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
W20240502 14:16:31.758383 19235 leader_election.cc:341] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.759307 19464 leader_election.cc:288] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.759341 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.762274 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:31.763561 19343 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.763023 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:31.763239 19466 leader_election.cc:288] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
W20240502 14:16:31.764214 19310 leader_election.cc:341] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.764479 19269 raft_consensus.cc:3037] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.764245 19417 raft_consensus.cc:2454] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.765125 19235 leader_election.cc:302] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.767082 19458 tablet_bootstrap.cc:492] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.768309 19503 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.769372 19268 raft_consensus.cc:2379] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 11c1d682e71e4bc4995b896158f9d0c5 in current term 1: Already voted for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in this term.
I20240502 14:16:31.770496 19466 raft_consensus.cc:2781] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:16:31.770725 19269 raft_consensus.cc:2454] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 1.
I20240502 14:16:31.771304 19418 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.771651 19466 raft_consensus.cc:482] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:31.771761 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.771852 19458 ts_tablet_manager.cc:1367] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.104s user 0.008s sys 0.015s
I20240502 14:16:31.772181 19504 raft_consensus.cc:504] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.774611 19458 raft_consensus.cc:348] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.774778 19416 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.774739 19503 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.775352 19232 leader_election.cc:302] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05; no voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.775482 19341 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.775460 19466 raft_consensus.cc:3037] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.778242 19466 raft_consensus.cc:504] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
W20240502 14:16:31.778628 19213 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:16:31.778986 19235 leader_election.cc:302] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.779091 19466 leader_election.cc:288] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.779050 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.779276 19417 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.779341 19500 raft_consensus.cc:2726] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:16:31.779893 19504 leader_election.cc:288] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:31.779896 19458 raft_consensus.cc:374] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.780083 19458 raft_consensus.cc:729] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.780200 19500 raft_consensus.cc:2781] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election won for term 1
W20240502 14:16:31.780556 19235 leader_election.cc:341] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:16:31.780825 19500 raft_consensus.cc:686] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:31.781872 19416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:31.781919 19458 consensus_queue.cc:260] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.782132 19416 raft_consensus.cc:3037] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.782248 19235 leader_election.cc:302] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.782281 19500 consensus_queue.cc:237] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.782738 19466 raft_consensus.cc:2781] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.782979 19466 raft_consensus.cc:686] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:31.783246 19417 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 1.
I20240502 14:16:31.784144 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:31.784763 19310 leader_election.cc:302] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.785106 19466 consensus_queue.cc:237] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.785339 19416 raft_consensus.cc:2454] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.785781 19235 leader_election.cc:302] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:31.786082 19500 raft_consensus.cc:2781] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.786309 19500 raft_consensus.cc:686] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:31.786072 19165 catalog_manager.cc:5484] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 1 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:31.786517 19343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.786778 19343 raft_consensus.cc:2379] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b56ee61e0083428fa6e4a23dd5cc3c05 in current term 1: Already voted for candidate 11c1d682e71e4bc4995b896158f9d0c5 in this term.
I20240502 14:16:31.786585 19500 consensus_queue.cc:237] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.784773 19341 raft_consensus.cc:2454] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 0.
I20240502 14:16:31.787539 19307 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5; no voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.787951 19464 raft_consensus.cc:2781] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.788130 19464 raft_consensus.cc:686] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:31.788422 19307 leader_election.cc:302] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters: b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.788556 19506 raft_consensus.cc:2726] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 14:16:31.788885 19506 raft_consensus.cc:2781] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:16:31.789032 19506 raft_consensus.cc:686] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:31.789327 19506 consensus_queue.cc:237] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.789628 19458 ts_tablet_manager.cc:1398] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20240502 14:16:31.790040 19458 tablet_bootstrap.cc:492] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4: Bootstrap starting.
I20240502 14:16:31.788434 19464 consensus_queue.cc:237] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.791786 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:31.792282 19458 tablet_bootstrap.cc:654] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4: Neither blocks nor log segments found. Creating new log.
I20240502 14:16:31.792387 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:31.792660 19341 raft_consensus.cc:3037] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.793373 19269 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:31.797326 19269 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 1.
I20240502 14:16:31.798243 19232 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05; no voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:31.798738 19341 raft_consensus.cc:2454] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 1.
I20240502 14:16:31.800522 19503 raft_consensus.cc:2726] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 14:16:31.804605 19458 tablet_bootstrap.cc:492] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4: No bootstrap required, opened a new log
I20240502 14:16:31.804972 19458 ts_tablet_manager.cc:1367] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20240502 14:16:31.806169 19458 raft_consensus.cc:348] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.806617 19458 raft_consensus.cc:374] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:16:31.806905 19458 raft_consensus.cc:729] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Initialized, Role: FOLLOWER
I20240502 14:16:31.807325 19458 consensus_queue.cc:260] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:31.808297 19458 ts_tablet_manager.cc:1398] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:16:31.814613 19164 catalog_manager.cc:5484] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 1 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:31.815522 19164 catalog_manager.cc:5484] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 0 to 1, leader changed from <none> to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 1 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:31.816397 19165 catalog_manager.cc:5484] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:31.817067 19165 catalog_manager.cc:5484] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:32.000623 19465 raft_consensus.cc:482] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:32.000869 19465 raft_consensus.cc:504] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:32.001592 19465 leader_election.cc:288] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:32.002279 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:32.002240 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:32.002580 19269 raft_consensus.cc:2379] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e2f86110a246a6987ec90202a3b2d4 in current term 1: Already voted for candidate 11c1d682e71e4bc4995b896158f9d0c5 in this term.
I20240502 14:16:32.003032 19381 leader_election.cc:302] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e2f86110a246a6987ec90202a3b2d4; no voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:32.003324 19465 raft_consensus.cc:3037] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:32.005403 19465 raft_consensus.cc:2726] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:16:32.154803 19465 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.161573 19465 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:32.161813 19465 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:32.162066 19520 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.162667 19465 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:32.163404 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5" is_pre_election: true
I20240502 14:16:32.163699 19341 raft_consensus.cc:2379] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e2f86110a246a6987ec90202a3b2d4 in current term 1: Already voted for candidate 11c1d682e71e4bc4995b896158f9d0c5 in this term.
I20240502 14:16:32.164528 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:32.164816 19269 raft_consensus.cc:2379] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9e2f86110a246a6987ec90202a3b2d4 in current term 1: Already voted for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in this term.
I20240502 14:16:32.165340 19381 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9e2f86110a246a6987ec90202a3b2d4; no voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:32.165719 19465 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:16:32.169013 19465 raft_consensus.cc:2726] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:16:32.181562 19465 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.186275 19465 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.201560 19500 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.207526 19503 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.232685 19511 consensus_queue.cc:1035] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.234200 19511 consensus_queue.cc:1035] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.237332 19500 consensus_queue.cc:1035] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.239611 19511 consensus_queue.cc:1035] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.245313 19464 consensus_queue.cc:1035] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.245783 19505 consensus_queue.cc:1035] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.294246 19505 consensus_queue.cc:1035] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.300073 19505 consensus_queue.cc:1035] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.310680 19505 consensus_queue.cc:1035] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:32.316309 19505 consensus_queue.cc:1035] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 14:16:32.779951 19213 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:16:33.498720 19464 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:16:33.498965 19464 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:33.499740 19464 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:33.500646 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" is_pre_election: true
I20240502 14:16:33.500646 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4" is_pre_election: true
I20240502 14:16:33.501017 19417 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 1.
I20240502 14:16:33.501022 19268 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 1.
I20240502 14:16:33.501659 19307 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters:
I20240502 14:16:33.502089 19464 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20240502 14:16:33.502249 19464 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:16:33.502388 19464 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:33.505045 19464 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:33.505923 19464 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:33.506644 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:33.506644 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:33.506955 19417 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:33.506939 19268 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:33.510206 19268 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:33.510203 19417 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:33.510982 19310 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:33.511328 19464 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:33.511708 19464 raft_consensus.cc:686] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:33.512215 19464 consensus_queue.cc:237] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:33.515341 19164 catalog_manager.cc:5484] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:33.864303 19417 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
mode: GRACEFUL
new_leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:56170
I20240502 14:16:33.864641 19417 raft_consensus.cc:595] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Received request to transfer leadership to TS b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:33.875206 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:52184
I20240502 14:16:33.875487 19341 raft_consensus.cc:595] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Received request to transfer leadership to TS b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:33.878249 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:52184
I20240502 14:16:33.878521 19341 raft_consensus.cc:595] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Received request to transfer leadership to TS b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:33.881366 19417 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:56170
I20240502 14:16:33.881690 19417 raft_consensus.cc:595] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:33.892522 19268 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:50248
I20240502 14:16:33.892849 19268 raft_consensus.cc:595] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:33.896414 19268 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:50248
I20240502 14:16:33.896806 19268 raft_consensus.cc:595] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:33.900089 19268 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:50248
I20240502 14:16:33.900446 19268 raft_consensus.cc:595] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:33.903473 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:52184
I20240502 14:16:33.903784 19341 raft_consensus.cc:595] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Received request to transfer leadership to TS b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:33.993005 19417 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20240502 14:16:33.993983 19464 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:33.999341 19268 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20240502 14:16:34.000008 19464 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:16:34.003360 19540 raft_consensus.cc:979] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:34.003633 19540 raft_consensus.cc:1067] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Signalling peer b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:34.004959 19268 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:50232
I20240502 14:16:34.005198 19268 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.005354 19268 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:34.007886 19268 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.008674 19268 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 3 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.009163 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:34.009379 19341 raft_consensus.cc:3032] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:34.009461 19341 raft_consensus.cc:729] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.009804 19341 consensus_queue.cc:260] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.010315 19341 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:34.010773 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.010998 19417 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:34.012712 19341 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 3.
I20240502 14:16:34.013253 19232 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters:
I20240502 14:16:34.013473 19417 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 3.
I20240502 14:16:34.013772 19466 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:34.014286 19466 raft_consensus.cc:686] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:34.014655 19466 consensus_queue.cc:237] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.017274 19166 catalog_manager.cc:5484] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 2 to 3, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 3 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.070963 19465 raft_consensus.cc:979] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: : Instructing follower b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:34.071161 19465 raft_consensus.cc:1067] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Signalling peer b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:34.071825 19268 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:50220
I20240502 14:16:34.072067 19268 raft_consensus.cc:482] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.072207 19268 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.074347 19268 raft_consensus.cc:504] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.075099 19268 leader_election.cc:288] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 2 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.075700 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.075706 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:34.075906 19417 raft_consensus.cc:3032] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.075979 19341 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.076048 19417 raft_consensus.cc:729] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:34.076400 19417 consensus_queue.cc:260] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.076786 19417 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.079264 19417 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 2.
I20240502 14:16:34.079252 19341 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 2.
I20240502 14:16:34.079867 19235 leader_election.cc:302] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:34.080221 19466 raft_consensus.cc:2781] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.080407 19466 raft_consensus.cc:686] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:34.080694 19466 consensus_queue.cc:237] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.083946 19166 catalog_manager.cc:5484] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 1 to 2, leader changed from b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3) to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 2 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.165787 19555 raft_consensus.cc:979] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.165997 19555 raft_consensus.cc:1067] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.166774 19341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52172
I20240502 14:16:34.166998 19341 raft_consensus.cc:482] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.167136 19341 raft_consensus.cc:3037] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.169247 19341 raft_consensus.cc:504] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.170004 19341 leader_election.cc:288] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.170591 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:34.170598 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b991e80285104823aa92c3a0d82254b6" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.170889 19417 raft_consensus.cc:3037] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.170886 19268 raft_consensus.cc:3032] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.171046 19268 raft_consensus.cc:729] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:34.171423 19268 consensus_queue.cc:260] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.171908 19268 raft_consensus.cc:3037] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.174465 19417 raft_consensus.cc:2454] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.175096 19268 raft_consensus.cc:2454] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.175158 19310 leader_election.cc:302] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:34.175535 19540 raft_consensus.cc:2781] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.175704 19540 raft_consensus.cc:686] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.176079 19540 consensus_queue.cc:237] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.178999 19166 catalog_manager.cc:5484] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 1 to 2, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.183926 19464 raft_consensus.cc:979] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:34.184109 19464 raft_consensus.cc:1067] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Signalling peer b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:34.184891 19417 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:56146
I20240502 14:16:34.185146 19417 raft_consensus.cc:482] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.185259 19417 raft_consensus.cc:3037] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.187500 19417 raft_consensus.cc:504] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.188134 19417 leader_election.cc:288] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:34.188763 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:34.188805 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a98858b66b342be9914a79d2ed8c057" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:34.189005 19341 raft_consensus.cc:3032] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.189013 19268 raft_consensus.cc:3037] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.189112 19341 raft_consensus.cc:729] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.189407 19341 consensus_queue.cc:260] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.189739 19341 raft_consensus.cc:3037] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.191462 19268 raft_consensus.cc:2454] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 2.
I20240502 14:16:34.191956 19341 raft_consensus.cc:2454] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 2.
I20240502 14:16:34.192418 19381 leader_election.cc:302] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:34.192976 19465 raft_consensus.cc:2781] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.193190 19465 raft_consensus.cc:686] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:34.193481 19465 consensus_queue.cc:237] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.196676 19166 catalog_manager.cc:5484] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 1 to 2, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 2 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:34.204259 19540 raft_consensus.cc:979] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:34.204787 19464 raft_consensus.cc:1067] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Signalling peer b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:34.205852 19268 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:50232
I20240502 14:16:34.206110 19268 raft_consensus.cc:482] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.206218 19268 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.208405 19268 raft_consensus.cc:504] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.209219 19268 leader_election.cc:288] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 2 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.209813 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:34.209821 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.210027 19341 raft_consensus.cc:3032] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.210090 19417 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.210116 19341 raft_consensus.cc:729] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.210425 19341 consensus_queue.cc:260] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.210842 19341 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.212546 19417 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 2.
I20240502 14:16:34.213001 19341 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 2.
I20240502 14:16:34.213045 19235 leader_election.cc:302] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:34.213454 19555 raft_consensus.cc:2781] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.213630 19555 raft_consensus.cc:686] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:34.213964 19555 consensus_queue.cc:237] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.216907 19166 catalog_manager.cc:5484] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 1 to 2, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 2 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.255535 19559 raft_consensus.cc:979] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.255720 19559 raft_consensus.cc:1067] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.256485 19341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52158
I20240502 14:16:34.256708 19341 raft_consensus.cc:482] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.256947 19341 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.259986 19341 raft_consensus.cc:504] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.260792 19341 leader_election.cc:288] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.261394 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:34.261476 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.261587 19268 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.261704 19417 raft_consensus.cc:3032] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.261796 19417 raft_consensus.cc:729] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:34.262130 19417 consensus_queue.cc:260] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.262574 19417 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.264549 19466 raft_consensus.cc:979] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.264596 19268 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.264737 19466 raft_consensus.cc:1067] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.265062 19307 leader_election.cc:302] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters:
I20240502 14:16:34.265373 19464 raft_consensus.cc:2781] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.265587 19464 raft_consensus.cc:686] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.265515 19341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52172
I20240502 14:16:34.265856 19417 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.265997 19341 raft_consensus.cc:482] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.265991 19464 consensus_queue.cc:237] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.266243 19341 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.268896 19341 raft_consensus.cc:504] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.269465 19166 catalog_manager.cc:5484] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 1 to 2, leader changed from b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.269893 19341 leader_election.cc:288] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.270107 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.270107 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:34.270385 19417 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.270505 19268 raft_consensus.cc:3032] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.270639 19268 raft_consensus.cc:729] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:34.270985 19268 consensus_queue.cc:260] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.271409 19268 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.274211 19417 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.274875 19268 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.274991 19310 leader_election.cc:302] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:34.275534 19464 raft_consensus.cc:2781] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.275738 19464 raft_consensus.cc:686] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.276131 19464 consensus_queue.cc:237] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.279637 19166 catalog_manager.cc:5484] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 1 to 2, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.340620 19555 raft_consensus.cc:979] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.340839 19555 raft_consensus.cc:1067] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:34.341533 19341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52172
I20240502 14:16:34.341771 19341 raft_consensus.cc:482] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:34.341871 19341 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.343982 19341 raft_consensus.cc:504] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.344653 19341 leader_election.cc:288] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:34.345249 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:34.345273 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:34.345558 19417 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.345566 19268 raft_consensus.cc:3032] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:34.345697 19268 raft_consensus.cc:729] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:34.346035 19268 consensus_queue.cc:260] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.346390 19268 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:34.348222 19417 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.348598 19268 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 2.
I20240502 14:16:34.348793 19310 leader_election.cc:302] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:34.349109 19464 raft_consensus.cc:2781] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:34.349265 19464 raft_consensus.cc:686] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:34.349570 19464 consensus_queue.cc:237] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:34.352384 19166 catalog_manager.cc:5484] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 1 to 2, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:34.469486 19417 raft_consensus.cc:1261] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.470134 19555 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.474037 19341 raft_consensus.cc:1261] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.474704 19466 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.511648 19341 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20240502 14:16:34.512367 19555 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.516629 19417 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20240502 14:16:34.517463 19466 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.649585 19417 raft_consensus.cc:1261] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.650310 19464 consensus_queue.cc:1035] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.654484 19268 raft_consensus.cc:1261] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.655444 19571 consensus_queue.cc:1035] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.733561 19417 raft_consensus.cc:1261] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.734333 19571 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.736907 19341 raft_consensus.cc:1261] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.737694 19466 consensus_queue.cc:1035] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.739257 19268 raft_consensus.cc:1261] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.739905 19464 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.745046 19417 raft_consensus.cc:1261] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.745875 19568 consensus_queue.cc:1035] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.796178 19341 raft_consensus.cc:1261] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.796921 19559 consensus_queue.cc:1035] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.801916 19268 raft_consensus.cc:1261] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.802781 19578 consensus_queue.cc:1035] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.824565 19268 raft_consensus.cc:1261] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.825675 19571 consensus_queue.cc:1035] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.831107 19417 raft_consensus.cc:1261] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.831816 19571 consensus_queue.cc:1035] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.860584 19417 raft_consensus.cc:1261] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.861282 19464 consensus_queue.cc:1035] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:34.866061 19268 raft_consensus.cc:1261] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:34.867033 19540 consensus_queue.cc:1035] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:36.916978 19136 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240502 14:16:36.917438 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:36.932019 19268 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "183dd83313904e87badf41634b333aeb"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:42258
I20240502 14:16:36.932296 19268 raft_consensus.cc:595] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Received request to transfer leadership to TS b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:36.939085 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:46170
I20240502 14:16:36.939374 19341 raft_consensus.cc:595] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Received request to transfer leadership to TS b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:36.940068 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240502 14:16:36.940368 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:37.355741 19466 raft_consensus.cc:979] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:37.356032 19466 raft_consensus.cc:1067] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Signalling peer b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:37.357007 19417 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "183dd83313904e87badf41634b333aeb"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:56158
I20240502 14:16:37.357240 19417 raft_consensus.cc:482] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:37.357384 19417 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:37.360716 19417 raft_consensus.cc:504] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:37.361409 19417 leader_election.cc:288] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 2 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:37.361997 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:37.361975 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:37.362236 19268 raft_consensus.cc:3032] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:16:37.362255 19341 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:37.362388 19268 raft_consensus.cc:729] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:37.362721 19268 consensus_queue.cc:260] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:37.363163 19268 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:16:37.365761 19341 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 2.
I20240502 14:16:37.365985 19268 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 2.
I20240502 14:16:37.366389 19381 leader_election.cc:302] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:37.366739 19587 raft_consensus.cc:2781] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:16:37.367208 19587 raft_consensus.cc:686] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:37.367522 19587 consensus_queue.cc:237] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:37.370440 19165 catalog_manager.cc:5484] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 1 to 2, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 2 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:37.414269 19598 raft_consensus.cc:979] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:37.414453 19598 raft_consensus.cc:1067] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Signalling peer b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:37.415213 19417 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:56146
I20240502 14:16:37.415457 19417 raft_consensus.cc:482] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:37.415568 19417 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:37.417585 19417 raft_consensus.cc:504] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:37.418223 19417 leader_election.cc:288] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 3 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:37.418838 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:37.418893 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:37.419023 19268 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:37.419144 19341 raft_consensus.cc:3032] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:37.419230 19341 raft_consensus.cc:729] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:37.419564 19341 consensus_queue.cc:260] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:37.419919 19341 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:37.422070 19268 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 3.
I20240502 14:16:37.422365 19341 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 3.
I20240502 14:16:37.422711 19381 leader_election.cc:302] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:37.423223 19587 raft_consensus.cc:2781] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:37.423396 19587 raft_consensus.cc:686] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:37.423698 19587 consensus_queue.cc:237] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:37.426628 19165 catalog_manager.cc:5484] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 2 to 3, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 3 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:37.773357 19341 raft_consensus.cc:1261] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:37.774073 19587 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:37.778709 19268 raft_consensus.cc:1261] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:16:37.779358 19602 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:16:37.940887 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:37.942498 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:37.942793 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:38.004209 19268 raft_consensus.cc:1261] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:38.005061 19602 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:38.009145 19341 raft_consensus.cc:1261] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:38.009759 19592 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:38.943390 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:38.946038 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:38.946264 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:39.946822 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:39.948477 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:39.948722 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:40.949209 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:40.950979 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:40.951200 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:41.951680 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:41.953336 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:41.953567 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:42.954061 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:42.956024 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:42.956238 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:43.956617 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:43.958266 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:43.958506 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:44.959028 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:44.960659 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:44.960844 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:45.961402 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:45.963164 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:45.963439 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:46.974606 19136 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240502 14:16:46.976962 19269 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:50248
I20240502 14:16:46.977241 19269 raft_consensus.cc:595] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:46.979553 19417 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "183dd83313904e87badf41634b333aeb"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:56170
I20240502 14:16:46.979777 19417 raft_consensus.cc:595] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:46.982213 19269 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:50248
I20240502 14:16:46.982437 19269 raft_consensus.cc:595] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:46.984576 19269 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:50248
I20240502 14:16:46.984786 19269 raft_consensus.cc:595] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:46.986845 19417 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
mode: GRACEFUL
new_leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:56170
I20240502 14:16:46.987039 19417 raft_consensus.cc:595] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Received request to transfer leadership to TS 11c1d682e71e4bc4995b896158f9d0c5
I20240502 14:16:47.043081 19617 raft_consensus.cc:979] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.043273 19617 raft_consensus.cc:1067] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.044042 19343 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52172
I20240502 14:16:47.044238 19343 raft_consensus.cc:482] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:47.044337 19343 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.046452 19343 raft_consensus.cc:504] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.047392 19343 leader_election.cc:288] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 3 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:47.047962 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:47.048015 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abbac7ba4c9f4d819d8c9a62850e4910" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:47.048143 19269 raft_consensus.cc:3032] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:47.048254 19269 raft_consensus.cc:729] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:47.048261 19417 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.048523 19269 consensus_queue.cc:260] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.048892 19269 raft_consensus.cc:3037] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.050640 19417 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 3.
I20240502 14:16:47.051007 19269 raft_consensus.cc:2454] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 3.
I20240502 14:16:47.051214 19310 leader_election.cc:302] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:47.051587 19616 raft_consensus.cc:2781] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:47.051746 19616 raft_consensus.cc:686] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:47.052047 19616 consensus_queue.cc:237] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.054966 19166 catalog_manager.cc:5484] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 2 to 3, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 3 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:47.062322 19615 raft_consensus.cc:979] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.062502 19615 raft_consensus.cc:1067] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.063251 19343 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52172
I20240502 14:16:47.063473 19343 raft_consensus.cc:482] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:47.063594 19343 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.065737 19343 raft_consensus.cc:504] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.066337 19343 leader_election.cc:288] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 3 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:47.066881 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:47.066879 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:47.067093 19269 raft_consensus.cc:3032] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:47.067118 19417 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.067198 19269 raft_consensus.cc:729] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:47.067466 19269 consensus_queue.cc:260] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.067875 19269 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.069478 19417 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 3.
I20240502 14:16:47.069906 19310 leader_election.cc:302] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:47.070225 19269 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 3.
I20240502 14:16:47.070227 19616 raft_consensus.cc:2781] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:47.070479 19616 raft_consensus.cc:686] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:47.070834 19616 consensus_queue.cc:237] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.071224 19623 raft_consensus.cc:979] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.071369 19623 raft_consensus.cc:1067] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.072196 19343 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "183dd83313904e87badf41634b333aeb"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52158
I20240502 14:16:47.072427 19343 raft_consensus.cc:482] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:47.072579 19343 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.073983 19166 catalog_manager.cc:5484] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 2 to 3, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 3 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:47.074514 19612 raft_consensus.cc:979] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.074695 19612 raft_consensus.cc:1067] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.075392 19341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52158
I20240502 14:16:47.075620 19341 raft_consensus.cc:482] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:47.075736 19341 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:47.076234 19343 raft_consensus.cc:504] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.076943 19343 leader_election.cc:288] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 3 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:47.077453 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:47.077659 19269 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.079222 19341 raft_consensus.cc:504] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.079216 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:47.079584 19417 raft_consensus.cc:3032] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:47.079763 19417 raft_consensus.cc:729] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:47.080199 19417 consensus_queue.cc:260] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.080711 19269 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 3.
I20240502 14:16:47.080833 19268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:47.080989 19417 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:47.081051 19268 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:47.081022 19416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d44409afb8c40ce820136fa8863ea0c" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:47.081205 19416 raft_consensus.cc:3032] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:16:47.081305 19416 raft_consensus.cc:729] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:47.081621 19416 consensus_queue.cc:260] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.082041 19416 raft_consensus.cc:3037] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:47.083362 19268 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 4.
I20240502 14:16:47.083812 19307 leader_election.cc:302] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters:
I20240502 14:16:47.084175 19307 leader_election.cc:302] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05; no voters:
I20240502 14:16:47.084251 19417 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 3.
I20240502 14:16:47.084458 19609 raft_consensus.cc:2781] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:47.084959 19609 raft_consensus.cc:686] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:47.085172 19625 raft_consensus.cc:2781] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:16:47.085434 19609 consensus_queue.cc:237] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.085007 19416 raft_consensus.cc:2454] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 4.
I20240502 14:16:47.085815 19625 raft_consensus.cc:686] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:47.085911 19341 leader_election.cc:288] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 4 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:47.086226 19625 consensus_queue.cc:237] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.089476 19166 catalog_manager.cc:5484] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 2 to 3, leader changed from b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 3 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:47.089993 19166 catalog_manager.cc:5484] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 3 to 4, leader changed from b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 4 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:47.495769 19268 raft_consensus.cc:1261] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:47.496374 19625 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.502233 19416 raft_consensus.cc:1261] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:47.503005 19625 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.521725 19617 raft_consensus.cc:979] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: : Instructing follower 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.521952 19617 raft_consensus.cc:1067] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Signalling peer 11c1d682e71e4bc4995b896158f9d0c5 to start an election
I20240502 14:16:47.522321 19416 raft_consensus.cc:1261] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:16:47.522665 19341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
from {username='slave'} at 127.0.0.1:52172
I20240502 14:16:47.522868 19341 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:47.523015 19341 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:47.522929 19625 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:47.525827 19341 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.526664 19341 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 4 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:47.527688 19268 raft_consensus.cc:1261] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:16:47.527817 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:47.528059 19269 raft_consensus.cc:3032] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:16:47.528160 19269 raft_consensus.cc:729] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:47.528366 19616 consensus_queue.cc:1035] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:47.528481 19269 consensus_queue.cc:260] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.528788 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "11c1d682e71e4bc4995b896158f9d0c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:47.528875 19269 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:47.528985 19417 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:47.531677 19417 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 4.
I20240502 14:16:47.531736 19269 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11c1d682e71e4bc4995b896158f9d0c5 in term 4.
I20240502 14:16:47.532181 19307 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 11c1d682e71e4bc4995b896158f9d0c5, b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:47.532492 19626 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:16:47.532660 19626 raft_consensus.cc:686] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Becoming Leader. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:47.533011 19626 consensus_queue.cc:237] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:47.536614 19165 catalog_manager.cc:5484] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 reported cstate change: term changed from 3 to 4, leader changed from b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1) to 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2). New cstate: current_term: 4 leader_uuid: "11c1d682e71e4bc4995b896158f9d0c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:47.630892 19269 raft_consensus.cc:1261] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:47.631539 19626 consensus_queue.cc:1035] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.635257 19417 raft_consensus.cc:1261] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:47.635869 19626 consensus_queue.cc:1035] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.665241 19417 raft_consensus.cc:1261] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:47.665980 19626 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.672549 19269 raft_consensus.cc:1261] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:47.673295 19616 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.923471 19269 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20240502 14:16:47.924798 19625 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:47.930055 19417 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Refusing update from remote peer 11c1d682e71e4bc4995b896158f9d0c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20240502 14:16:47.930811 19625 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:50.004455 19136 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240502 14:16:50.004789 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:50.007434 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:46170
I20240502 14:16:50.007704 19341 raft_consensus.cc:595] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Received request to transfer leadership to TS b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:50.008817 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "183dd83313904e87badf41634b333aeb"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:46170
I20240502 14:16:50.009056 19341 raft_consensus.cc:595] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Received request to transfer leadership to TS b9e2f86110a246a6987ec90202a3b2d4
I20240502 14:16:50.010111 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:46170
I20240502 14:16:50.010304 19341 raft_consensus.cc:595] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Received request to transfer leadership to TS b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:50.011327 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:46170
I20240502 14:16:50.011521 19341 raft_consensus.cc:595] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Received request to transfer leadership to TS b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:50.012485 19341 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9"
dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
mode: GRACEFUL
new_leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:46170
I20240502 14:16:50.012668 19341 raft_consensus.cc:595] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Received request to transfer leadership to TS b56ee61e0083428fa6e4a23dd5cc3c05
I20240502 14:16:50.013090 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240502 14:16:50.013317 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:50.092514 19625 raft_consensus.cc:979] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:50.092731 19625 raft_consensus.cc:1067] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Signalling peer b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:50.093537 19269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:50232
I20240502 14:16:50.093789 19269 raft_consensus.cc:482] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:50.093924 19269 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:50.096647 19269 raft_consensus.cc:504] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.097573 19269 leader_election.cc:288] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 4 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:50.098088 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:50.098112 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6fcade6e81649b5beffddfcf6fe11c9" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:50.098305 19341 raft_consensus.cc:3032] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:16:50.098304 19417 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:50.098417 19341 raft_consensus.cc:729] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:50.098745 19341 consensus_queue.cc:260] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.099098 19341 raft_consensus.cc:3037] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:50.100970 19417 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 4.
I20240502 14:16:50.101471 19341 raft_consensus.cc:2454] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 4.
I20240502 14:16:50.101506 19235 leader_election.cc:302] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:50.101814 19625 raft_consensus.cc:979] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:50.101954 19625 raft_consensus.cc:1067] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Signalling peer b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:50.102138 19645 raft_consensus.cc:2781] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:16:50.102728 19645 raft_consensus.cc:686] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:50.102843 19417 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:56146
I20240502 14:16:50.103165 19417 raft_consensus.cc:482] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:50.103107 19645 consensus_queue.cc:237] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.103348 19417 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:50.105859 19417 raft_consensus.cc:504] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.106374 19166 catalog_manager.cc:5484] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 3 to 4, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 4 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:50.106843 19417 leader_election.cc:288] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 3 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:50.107355 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:50.107362 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e5c26e9ea0e4f97ae900e409c26574a" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:50.107688 19269 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:50.107684 19341 raft_consensus.cc:3032] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:50.107856 19341 raft_consensus.cc:729] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:50.108158 19341 consensus_queue.cc:260] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.108588 19341 raft_consensus.cc:3037] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:50.110471 19269 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 3.
I20240502 14:16:50.111122 19381 leader_election.cc:302] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:50.111536 19623 raft_consensus.cc:2781] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:50.111963 19341 raft_consensus.cc:2454] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 3.
I20240502 14:16:50.112236 19623 raft_consensus.cc:686] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:50.112632 19623 consensus_queue.cc:237] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.115487 19166 catalog_manager.cc:5484] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 2 to 3, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 3 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:50.218156 19644 raft_consensus.cc:979] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:50.218341 19644 raft_consensus.cc:1067] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Signalling peer b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:50.219081 19269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:50232
I20240502 14:16:50.219296 19269 raft_consensus.cc:482] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:50.219419 19269 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:50.221714 19269 raft_consensus.cc:504] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.222399 19269 leader_election.cc:288] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 3 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:50.222987 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:50.223189 19417 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:50.225184 19417 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 3.
I20240502 14:16:50.225826 19235 leader_election.cc:302] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:50.225921 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51bc2a3486284529a2e33ca12f9b70e4" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:50.226168 19645 raft_consensus.cc:2781] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:16:50.226192 19341 raft_consensus.cc:3032] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:16:50.226346 19341 raft_consensus.cc:729] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:50.226372 19645 raft_consensus.cc:686] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:50.226687 19645 consensus_queue.cc:237] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.226761 19341 consensus_queue.cc:260] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.227124 19341 raft_consensus.cc:3037] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:16:50.229633 19166 catalog_manager.cc:5484] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 2 to 3, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 3 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:50.230024 19341 raft_consensus.cc:2454] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 3.
I20240502 14:16:50.245358 19625 raft_consensus.cc:979] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:50.245534 19625 raft_consensus.cc:1067] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Signalling peer b9e2f86110a246a6987ec90202a3b2d4 to start an election
I20240502 14:16:50.246304 19417 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "183dd83313904e87badf41634b333aeb"
dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
from {username='slave'} at 127.0.0.1:56146
I20240502 14:16:50.246594 19417 raft_consensus.cc:482] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:50.246727 19417 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:50.249250 19417 raft_consensus.cc:504] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.249945 19417 leader_election.cc:288] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 4 election: Requested vote from peers b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241), 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167)
I20240502 14:16:50.250494 19269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
I20240502 14:16:50.250591 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183dd83313904e87badf41634b333aeb" candidate_uuid: "b9e2f86110a246a6987ec90202a3b2d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:50.250787 19341 raft_consensus.cc:3032] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:16:50.250836 19269 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:50.250891 19341 raft_consensus.cc:729] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:50.251216 19341 consensus_queue.cc:260] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.251665 19341 raft_consensus.cc:3037] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:16:50.254165 19269 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 4.
I20240502 14:16:50.254451 19341 raft_consensus.cc:2454] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9e2f86110a246a6987ec90202a3b2d4 in term 4.
I20240502 14:16:50.254856 19381 leader_election.cc:302] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:50.255203 19623 raft_consensus.cc:2781] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:16:50.255364 19623 raft_consensus.cc:686] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 4 LEADER]: Becoming Leader. State: Replica: b9e2f86110a246a6987ec90202a3b2d4, State: Running, Role: LEADER
I20240502 14:16:50.255656 19623 consensus_queue.cc:237] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.258631 19166 catalog_manager.cc:5484] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 reported cstate change: term changed from 3 to 4, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3). New cstate: current_term: 4 leader_uuid: "b9e2f86110a246a6987ec90202a3b2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: HEALTHY } } }
I20240502 14:16:50.362377 19644 raft_consensus.cc:979] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: : Instructing follower b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:50.362618 19625 raft_consensus.cc:1067] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Signalling peer b56ee61e0083428fa6e4a23dd5cc3c05 to start an election
I20240502 14:16:50.363373 19269 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e"
dest_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05"
from {username='slave'} at 127.0.0.1:50232
I20240502 14:16:50.363605 19269 raft_consensus.cc:482] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:16:50.363765 19269 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Advancing to term 5
I20240502 14:16:50.366175 19269 raft_consensus.cc:504] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.366933 19269 leader_election.cc:288] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 5 election: Requested vote from peers 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2:36167), b9e2f86110a246a6987ec90202a3b2d4 (127.18.176.3:38477)
I20240502 14:16:50.367393 19341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "11c1d682e71e4bc4995b896158f9d0c5"
I20240502 14:16:50.367498 19417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b030e44b43a748f6b366b197e2fd1b8e" candidate_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b9e2f86110a246a6987ec90202a3b2d4"
I20240502 14:16:50.367648 19341 raft_consensus.cc:3032] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Stepping down as leader of term 4
I20240502 14:16:50.367676 19417 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Advancing to term 5
I20240502 14:16:50.367756 19341 raft_consensus.cc:729] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 11c1d682e71e4bc4995b896158f9d0c5, State: Running, Role: LEADER
I20240502 14:16:50.368094 19341 consensus_queue.cc:260] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.368521 19341 raft_consensus.cc:3037] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Advancing to term 5
I20240502 14:16:50.370143 19417 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 5.
I20240502 14:16:50.370733 19235 leader_election.cc:302] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b56ee61e0083428fa6e4a23dd5cc3c05, b9e2f86110a246a6987ec90202a3b2d4; no voters:
I20240502 14:16:50.371026 19341 raft_consensus.cc:2454] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b56ee61e0083428fa6e4a23dd5cc3c05 in term 5.
I20240502 14:16:50.371114 19645 raft_consensus.cc:2781] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 5 FOLLOWER]: Leader election won for term 5
I20240502 14:16:50.371276 19645 raft_consensus.cc:686] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 5 LEADER]: Becoming Leader. State: Replica: b56ee61e0083428fa6e4a23dd5cc3c05, State: Running, Role: LEADER
I20240502 14:16:50.371609 19645 consensus_queue.cc:237] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } }
I20240502 14:16:50.374958 19166 catalog_manager.cc:5484] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 reported cstate change: term changed from 4 to 5, leader changed from 11c1d682e71e4bc4995b896158f9d0c5 (127.18.176.2) to b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1). New cstate: current_term: 5 leader_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 } health_report { overall_health: UNKNOWN } } }
I20240502 14:16:50.549914 19269 raft_consensus.cc:1261] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:50.550779 19623 consensus_queue.cc:1035] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:50.555383 19341 raft_consensus.cc:1261] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:50.556087 19623 consensus_queue.cc:1035] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:50.636360 19341 raft_consensus.cc:1261] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:16:50.637028 19659 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:50.641088 19269 raft_consensus.cc:1261] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Refusing update from remote peer b9e2f86110a246a6987ec90202a3b2d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:16:50.641835 19652 consensus_queue.cc:1035] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56ee61e0083428fa6e4a23dd5cc3c05" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:50.645375 19341 raft_consensus.cc:1261] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:16:50.645972 19645 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:50.649911 19417 raft_consensus.cc:1261] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:16:50.650645 19646 consensus_queue.cc:1035] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:50.687177 19417 raft_consensus.cc:1261] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:50.687865 19666 consensus_queue.cc:1035] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:50.692008 19341 raft_consensus.cc:1261] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:16:50.692538 19666 consensus_queue.cc:1035] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:16:50.755824 19341 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 5 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20240502 14:16:50.755824 19417 raft_consensus.cc:1261] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 5 FOLLOWER]: Refusing update from remote peer b56ee61e0083428fa6e4a23dd5cc3c05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20240502 14:16:50.756464 19645 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11c1d682e71e4bc4995b896158f9d0c5" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:50.756752 19666 consensus_queue.cc:1035] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e2f86110a246a6987ec90202a3b2d4" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:16:51.013833 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:51.015763 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:51.016052 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:52.016611 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:52.018226 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:52.018463 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:53.018994 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:53.020702 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:53.020956 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:54.021347 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:54.023121 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:54.023340 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:55.023757 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:55.025452 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:55.025730 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:56.026327 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:56.028260 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:56.028518 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:57.029060 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:57.030869 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:57.031133 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:58.031605 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:58.033824 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:58.034080 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:16:59.034698 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:16:59.036456 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:16:59.036710 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:00.050612 19136 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240502 14:17:00.050968 19136 tablet_server.cc:178] TabletServer@127.18.176.1:0 shutting down...
W20240502 14:17:00.062831 19307 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20240502 14:17:00.065039 19136 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 14:17:00.065562 19136 tablet_replica.cc:330] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.066278 19136 raft_consensus.cc:2229] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.066756 19136 raft_consensus.cc:2258] T 6a98858b66b342be9914a79d2ed8c057 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20240502 14:17:00.068038 19307 consensus_peers.cc:485] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 -> Peer b56ee61e0083428fa6e4a23dd5cc3c05 (127.18.176.1:43241): Couldn't send request to peer b56ee61e0083428fa6e4a23dd5cc3c05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:00.068662 19136 tablet_replica.cc:330] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.068912 19136 raft_consensus.cc:2229] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.069293 19136 raft_consensus.cc:2258] T d6fcade6e81649b5beffddfcf6fe11c9 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.069885 19136 tablet_replica.cc:330] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.070040 19136 raft_consensus.cc:2229] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.070194 19136 raft_consensus.cc:2258] T abbac7ba4c9f4d819d8c9a62850e4910 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.070734 19136 tablet_replica.cc:330] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.070892 19136 raft_consensus.cc:2229] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.071048 19136 raft_consensus.cc:2258] T 2d44409afb8c40ce820136fa8863ea0c P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.071512 19136 tablet_replica.cc:330] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.071681 19136 raft_consensus.cc:2229] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.071878 19136 raft_consensus.cc:2258] T 183dd83313904e87badf41634b333aeb P b56ee61e0083428fa6e4a23dd5cc3c05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.072356 19136 tablet_replica.cc:330] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.072539 19136 raft_consensus.cc:2229] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.072693 19136 raft_consensus.cc:2258] T b991e80285104823aa92c3a0d82254b6 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.073246 19136 tablet_replica.cc:330] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.073371 19136 raft_consensus.cc:2229] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.073668 19136 raft_consensus.cc:2258] T 51bc2a3486284529a2e33ca12f9b70e4 P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.074147 19136 tablet_replica.cc:330] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.074278 19136 raft_consensus.cc:2229] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.074409 19136 raft_consensus.cc:2258] T 0e5c26e9ea0e4f97ae900e409c26574a P b56ee61e0083428fa6e4a23dd5cc3c05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.074862 19136 tablet_replica.cc:330] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05: stopping tablet replica
I20240502 14:17:00.074991 19136 raft_consensus.cc:2229] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 5 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.075273 19136 raft_consensus.cc:2258] T b030e44b43a748f6b366b197e2fd1b8e P b56ee61e0083428fa6e4a23dd5cc3c05 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.095034 19136 tablet_server.cc:194] TabletServer@127.18.176.1:0 shutdown complete.
I20240502 14:17:00.103245 19136 tablet_server.cc:178] TabletServer@127.18.176.2:0 shutting down...
I20240502 14:17:00.112800 19136 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 14:17:00.113133 19136 tablet_replica.cc:330] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.113355 19136 raft_consensus.cc:2229] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.113598 19136 raft_consensus.cc:2258] T 0e5c26e9ea0e4f97ae900e409c26574a P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.114264 19136 tablet_replica.cc:330] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.114442 19136 raft_consensus.cc:2229] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.114642 19136 raft_consensus.cc:2258] T 6a98858b66b342be9914a79d2ed8c057 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.115175 19136 tablet_replica.cc:330] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.115319 19136 raft_consensus.cc:2229] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.115476 19136 raft_consensus.cc:2258] T d6fcade6e81649b5beffddfcf6fe11c9 P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.115928 19136 tablet_replica.cc:330] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.116071 19136 raft_consensus.cc:2229] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.116387 19136 raft_consensus.cc:2258] T abbac7ba4c9f4d819d8c9a62850e4910 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.116842 19136 tablet_replica.cc:330] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.117224 19136 raft_consensus.cc:2229] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.117587 19136 raft_consensus.cc:2258] T b030e44b43a748f6b366b197e2fd1b8e P 11c1d682e71e4bc4995b896158f9d0c5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.118373 19136 tablet_replica.cc:330] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.118638 19136 raft_consensus.cc:2229] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.118875 19136 raft_consensus.cc:2258] T 183dd83313904e87badf41634b333aeb P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.119593 19136 tablet_replica.cc:330] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.119798 19136 raft_consensus.cc:2229] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.120193 19136 raft_consensus.cc:2258] T 2d44409afb8c40ce820136fa8863ea0c P 11c1d682e71e4bc4995b896158f9d0c5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.120704 19136 tablet_replica.cc:330] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.120872 19136 raft_consensus.cc:2229] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.121026 19136 raft_consensus.cc:2258] T 51bc2a3486284529a2e33ca12f9b70e4 P 11c1d682e71e4bc4995b896158f9d0c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.121538 19136 tablet_replica.cc:330] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5: stopping tablet replica
I20240502 14:17:00.121698 19136 raft_consensus.cc:2229] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.122041 19136 raft_consensus.cc:2258] T b991e80285104823aa92c3a0d82254b6 P 11c1d682e71e4bc4995b896158f9d0c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.139956 19136 tablet_server.cc:194] TabletServer@127.18.176.2:0 shutdown complete.
I20240502 14:17:00.145314 19136 tablet_server.cc:178] TabletServer@127.18.176.3:0 shutting down...
I20240502 14:17:00.155972 19136 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 14:17:00.156513 19136 tablet_replica.cc:330] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.157017 19136 raft_consensus.cc:2229] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.157541 19136 raft_consensus.cc:2258] T b030e44b43a748f6b366b197e2fd1b8e P b9e2f86110a246a6987ec90202a3b2d4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.158319 19136 tablet_replica.cc:330] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.158609 19136 raft_consensus.cc:2229] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.158970 19136 raft_consensus.cc:2258] T 6a98858b66b342be9914a79d2ed8c057 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.159634 19136 tablet_replica.cc:330] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.159899 19136 raft_consensus.cc:2229] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.160121 19136 raft_consensus.cc:2258] T abbac7ba4c9f4d819d8c9a62850e4910 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.160691 19136 tablet_replica.cc:330] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.160852 19136 raft_consensus.cc:2229] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.161010 19136 raft_consensus.cc:2258] T d6fcade6e81649b5beffddfcf6fe11c9 P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.161931 19136 tablet_replica.cc:330] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.162120 19136 raft_consensus.cc:2229] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 4 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.162838 19136 raft_consensus.cc:2258] T 183dd83313904e87badf41634b333aeb P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.163502 19136 tablet_replica.cc:330] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.163677 19136 raft_consensus.cc:2229] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.163818 19136 raft_consensus.cc:2258] T 2d44409afb8c40ce820136fa8863ea0c P b9e2f86110a246a6987ec90202a3b2d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.164278 19136 tablet_replica.cc:330] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.164404 19136 raft_consensus.cc:2229] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.164566 19136 raft_consensus.cc:2258] T b991e80285104823aa92c3a0d82254b6 P b9e2f86110a246a6987ec90202a3b2d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.164983 19136 tablet_replica.cc:330] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.165117 19136 raft_consensus.cc:2229] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:00.165259 19136 raft_consensus.cc:2258] T 51bc2a3486284529a2e33ca12f9b70e4 P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.165727 19136 tablet_replica.cc:330] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4: stopping tablet replica
I20240502 14:17:00.165848 19136 raft_consensus.cc:2229] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 3 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.166153 19136 raft_consensus.cc:2258] T 0e5c26e9ea0e4f97ae900e409c26574a P b9e2f86110a246a6987ec90202a3b2d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.182283 19136 tablet_server.cc:194] TabletServer@127.18.176.3:0 shutdown complete.
I20240502 14:17:00.187477 19136 master.cc:537] Master@127.18.176.62:46653 shutting down...
I20240502 14:17:00.197180 19136 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 1 LEADER]: Raft consensus shutting down.
I20240502 14:17:00.197543 19136 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:00.197715 19136 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4b969661996245998bd9398114165047: stopping tablet replica
I20240502 14:17:00.212965 19136 master.cc:552] Master@127.18.176.62:46653 shutdown complete.
11c1d682e71e4bc4995b896158f9d0c5 4
b56ee61e0083428fa6e4a23dd5cc3c05 4
b9e2f86110a246a6987ec90202a3b2d4 1
11c1d682e71e4bc4995b896158f9d0c5 3
b56ee61e0083428fa6e4a23dd5cc3c05 3
b9e2f86110a246a6987ec90202a3b2d4 3
11c1d682e71e4bc4995b896158f9d0c5 8
b56ee61e0083428fa6e4a23dd5cc3c05 0
b9e2f86110a246a6987ec90202a3b2d4 1
11c1d682e71e4bc4995b896158f9d0c5 3
b56ee61e0083428fa6e4a23dd5cc3c05 3
b9e2f86110a246a6987ec90202a3b2d4 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (29616 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240502 14:17:00.240181 19136 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.176.62:41877
I20240502 14:17:00.240864 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:00.244271 19682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.244253 19681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.244740 19684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:00.245210 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:00.245519 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:00.245589 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:00.245643 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659420245610 us; error 0 us; skew 500 ppm
I20240502 14:17:00.245864 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:00.252492 19136 webserver.cc:460] Webserver started at http://127.18.176.62:33987/ using document root <none> and password file <none>
I20240502 14:17:00.252852 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:00.252980 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:00.253182 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:00.254259 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/master-0-root/instance:
uuid: "81d7a1162af44f839bb8236ff0997a1d"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.258195 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20240502 14:17:00.260881 19689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.261585 19136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:00.261827 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/master-0-root
uuid: "81d7a1162af44f839bb8236ff0997a1d"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.262056 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:00.297996 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:00.299042 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:00.318344 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.62:41877
I20240502 14:17:00.318364 19740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.62:41877 every 8 connection(s)
I20240502 14:17:00.320062 19741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.324934 19741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d: Bootstrap starting.
I20240502 14:17:00.326498 19741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.328562 19741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d: No bootstrap required, opened a new log
I20240502 14:17:00.329308 19741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81d7a1162af44f839bb8236ff0997a1d" member_type: VOTER }
I20240502 14:17:00.329480 19741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.329581 19741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d7a1162af44f839bb8236ff0997a1d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.329838 19741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81d7a1162af44f839bb8236ff0997a1d" member_type: VOTER }
I20240502 14:17:00.329988 19741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 14:17:00.330065 19741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 14:17:00.330190 19741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.332263 19741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81d7a1162af44f839bb8236ff0997a1d" member_type: VOTER }
I20240502 14:17:00.332530 19741 leader_election.cc:302] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81d7a1162af44f839bb8236ff0997a1d; no voters:
I20240502 14:17:00.333029 19741 leader_election.cc:288] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 14:17:00.333202 19744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:00.333715 19744 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 1 LEADER]: Becoming Leader. State: Replica: 81d7a1162af44f839bb8236ff0997a1d, State: Running, Role: LEADER
I20240502 14:17:00.333999 19741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [sys.catalog]: configured and running, proceeding with master startup.
I20240502 14:17:00.334038 19744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81d7a1162af44f839bb8236ff0997a1d" member_type: VOTER }
I20240502 14:17:00.335011 19745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81d7a1162af44f839bb8236ff0997a1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81d7a1162af44f839bb8236ff0997a1d" member_type: VOTER } }
I20240502 14:17:00.335085 19746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81d7a1162af44f839bb8236ff0997a1d. Latest consensus state: current_term: 1 leader_uuid: "81d7a1162af44f839bb8236ff0997a1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81d7a1162af44f839bb8236ff0997a1d" member_type: VOTER } }
I20240502 14:17:00.335371 19746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [sys.catalog]: This master's current role is: LEADER
I20240502 14:17:00.335371 19745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [sys.catalog]: This master's current role is: LEADER
I20240502 14:17:00.336742 19749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 14:17:00.338788 19749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 14:17:00.340759 19136 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 14:17:00.342402 19749 catalog_manager.cc:1347] Generated new cluster ID: 7885d153432b4e6fbb39fc1a9572f747
I20240502 14:17:00.342506 19749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 14:17:00.349035 19749 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 14:17:00.349838 19749 catalog_manager.cc:1504] Loading token signing keys...
I20240502 14:17:00.364761 19749 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d: Generated new TSK 0
I20240502 14:17:00.365073 19749 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 14:17:00.373915 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:00.377468 19762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.377455 19763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.377966 19765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:00.378829 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:00.379123 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:00.379206 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:00.379251 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659420379237 us; error 0 us; skew 500 ppm
I20240502 14:17:00.379395 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:00.380792 19136 webserver.cc:460] Webserver started at http://127.18.176.1:42729/ using document root <none> and password file <none>
I20240502 14:17:00.381055 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:00.381131 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:00.381273 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:00.381984 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-0-root/instance:
uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.385001 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20240502 14:17:00.387049 19770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.387517 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 14:17:00.387665 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-0-root
uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.387802 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:00.398236 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:00.399154 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:00.399828 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:00.400815 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:00.400899 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.400986 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:00.401042 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.416503 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.1:42239
I20240502 14:17:00.416538 19832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.1:42239 every 8 connection(s)
I20240502 14:17:00.418279 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:00.421861 19837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.422188 19838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:00.424664 19136 server_base.cc:1034] running on GCE node
W20240502 14:17:00.424693 19840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:00.425299 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:00.425405 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:00.425487 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659420425442 us; error 0 us; skew 500 ppm
I20240502 14:17:00.425663 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:00.427320 19136 webserver.cc:460] Webserver started at http://127.18.176.2:36951/ using document root <none> and password file <none>
I20240502 14:17:00.427708 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:00.427843 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:00.428092 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:00.429011 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-1-root/instance:
uuid: "e7ad344eaca649949d0b8ca36f87f068"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.429716 19833 heartbeater.cc:347] Connected to a master server at 127.18.176.62:41877
I20240502 14:17:00.429858 19833 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:00.430311 19833 heartbeater.cc:511] Master 127.18.176.62:41877 requested a full tablet report, sending...
I20240502 14:17:00.431336 19706 ts_manager.cc:194] Registered new tserver with Master: 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239)
I20240502 14:17:00.432212 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20240502 14:17:00.432760 19706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49542
I20240502 14:17:00.434178 19845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.434602 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 14:17:00.434724 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-1-root
uuid: "e7ad344eaca649949d0b8ca36f87f068"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.434897 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:00.446995 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:00.447700 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:00.448290 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:00.449271 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:00.449343 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.449466 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:00.449518 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.466275 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.2:43175
I20240502 14:17:00.466308 19907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.2:43175 every 8 connection(s)
I20240502 14:17:00.468173 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:00.471884 19912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.473882 19911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:00.473986 19914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:00.475355 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:00.475880 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:00.476013 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:00.476087 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659420476062 us; error 0 us; skew 500 ppm
I20240502 14:17:00.476264 19908 heartbeater.cc:347] Connected to a master server at 127.18.176.62:41877
I20240502 14:17:00.476301 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:00.476433 19908 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:00.476892 19908 heartbeater.cc:511] Master 127.18.176.62:41877 requested a full tablet report, sending...
I20240502 14:17:00.478013 19136 webserver.cc:460] Webserver started at http://127.18.176.3:37749/ using document root <none> and password file <none>
I20240502 14:17:00.478035 19706 ts_manager.cc:194] Registered new tserver with Master: e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:00.478379 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:00.478495 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:00.478701 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:00.479192 19706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49556
I20240502 14:17:00.479562 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-2-root/instance:
uuid: "f20ea149e0a049829dc1d8810f7a5e31"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.482422 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 14:17:00.484339 19919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.484732 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 14:17:00.484869 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-2-root
uuid: "f20ea149e0a049829dc1d8810f7a5e31"
format_stamp: "Formatted at 2024-05-02 14:17:00 on dist-test-slave-02q2"
I20240502 14:17:00.485015 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714659390546060-19136-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:00.492964 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:00.493652 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:00.494315 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:00.495333 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:00.495434 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.495548 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:00.495620 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:00.512701 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.3:35039
I20240502 14:17:00.512738 19981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.3:35039 every 8 connection(s)
I20240502 14:17:00.520808 19982 heartbeater.cc:347] Connected to a master server at 127.18.176.62:41877
I20240502 14:17:00.521021 19982 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:00.521485 19982 heartbeater.cc:511] Master 127.18.176.62:41877 requested a full tablet report, sending...
I20240502 14:17:00.522564 19706 ts_manager.cc:194] Registered new tserver with Master: f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.522996 19136 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.009224726s
I20240502 14:17:00.523666 19706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49566
I20240502 14:17:00.524439 19136 test_util.cc:268] Using random seed: 1101778817
I20240502 14:17:00.538354 19706 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49580:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 14:17:00.539404 19706 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 14:17:00.565426 19794 tablet_service.cc:1467] Processing CreateTablet for tablet e365a5ebb6d840dc8b1e88886fd89029 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 14:17:00.568054 19798 tablet_service.cc:1467] Processing CreateTablet for tablet 2888d23ddf87436199097249d3376f51 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 14:17:00.568300 19794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e365a5ebb6d840dc8b1e88886fd89029. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.568660 19798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2888d23ddf87436199097249d3376f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.569636 19797 tablet_service.cc:1467] Processing CreateTablet for tablet 218fb1b729b74ac2bf6067fed6871989 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 14:17:00.570487 19797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 218fb1b729b74ac2bf6067fed6871989. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.570487 19796 tablet_service.cc:1467] Processing CreateTablet for tablet f48acad258464650873b115bf412c2e8 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 14:17:00.570663 19795 tablet_service.cc:1467] Processing CreateTablet for tablet 103f07eafa5e448fa7b87a06f341de95 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 14:17:00.571235 19795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 103f07eafa5e448fa7b87a06f341de95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.577900 19793 tablet_service.cc:1467] Processing CreateTablet for tablet f351b236cbf7446480345c0a126aad9d (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 14:17:00.578617 19792 tablet_service.cc:1467] Processing CreateTablet for tablet 67a0809e54dd4d4d86c3989974bf2519 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 14:17:00.579144 19791 tablet_service.cc:1467] Processing CreateTablet for tablet 940723383ee8421fb6cb9a7281fdf8f9 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 14:17:00.579643 19790 tablet_service.cc:1467] Processing CreateTablet for tablet b56fffeac0494533a94ae337979bd8cb (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 14:17:00.580129 19789 tablet_service.cc:1467] Processing CreateTablet for tablet 1f56ac46a0754affa20b9aa5b917963c (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 14:17:00.580650 19793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f351b236cbf7446480345c0a126aad9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.580955 19796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f48acad258464650873b115bf412c2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.583484 19947 tablet_service.cc:1467] Processing CreateTablet for tablet 2888d23ddf87436199097249d3376f51 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 14:17:00.584051 19947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2888d23ddf87436199097249d3376f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.585613 19790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b56fffeac0494533a94ae337979bd8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.586714 19792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67a0809e54dd4d4d86c3989974bf2519. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.587112 19946 tablet_service.cc:1467] Processing CreateTablet for tablet 218fb1b729b74ac2bf6067fed6871989 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 14:17:00.587692 19946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 218fb1b729b74ac2bf6067fed6871989. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.588809 19789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f56ac46a0754affa20b9aa5b917963c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.590844 19791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 940723383ee8421fb6cb9a7281fdf8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.591305 19944 tablet_service.cc:1467] Processing CreateTablet for tablet 103f07eafa5e448fa7b87a06f341de95 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 14:17:00.591600 19938 tablet_service.cc:1467] Processing CreateTablet for tablet 1f56ac46a0754affa20b9aa5b917963c (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 14:17:00.596732 19997 tablet_bootstrap.cc:492] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.597235 19944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 103f07eafa5e448fa7b87a06f341de95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.601261 19938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f56ac46a0754affa20b9aa5b917963c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.596880 19939 tablet_service.cc:1467] Processing CreateTablet for tablet b56fffeac0494533a94ae337979bd8cb (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 14:17:00.598456 19941 tablet_service.cc:1467] Processing CreateTablet for tablet 67a0809e54dd4d4d86c3989974bf2519 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 14:17:00.602725 19942 tablet_service.cc:1467] Processing CreateTablet for tablet f351b236cbf7446480345c0a126aad9d (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 14:17:00.610129 19940 tablet_service.cc:1467] Processing CreateTablet for tablet 940723383ee8421fb6cb9a7281fdf8f9 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 14:17:00.604888 19945 tablet_service.cc:1467] Processing CreateTablet for tablet f48acad258464650873b115bf412c2e8 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 14:17:00.610911 19939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b56fffeac0494533a94ae337979bd8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.614744 19941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67a0809e54dd4d4d86c3989974bf2519. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.613804 19872 tablet_service.cc:1467] Processing CreateTablet for tablet 218fb1b729b74ac2bf6067fed6871989 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 14:17:00.615584 19871 tablet_service.cc:1467] Processing CreateTablet for tablet f48acad258464650873b115bf412c2e8 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 14:17:00.615621 19869 tablet_service.cc:1467] Processing CreateTablet for tablet e365a5ebb6d840dc8b1e88886fd89029 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 14:17:00.615872 19872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 218fb1b729b74ac2bf6067fed6871989. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.615990 19873 tablet_service.cc:1467] Processing CreateTablet for tablet 2888d23ddf87436199097249d3376f51 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 14:17:00.616139 19871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f48acad258464650873b115bf412c2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.611629 19943 tablet_service.cc:1467] Processing CreateTablet for tablet e365a5ebb6d840dc8b1e88886fd89029 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 14:17:00.614574 19870 tablet_service.cc:1467] Processing CreateTablet for tablet 103f07eafa5e448fa7b87a06f341de95 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 14:17:00.619643 19873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2888d23ddf87436199097249d3376f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.620002 19940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 940723383ee8421fb6cb9a7281fdf8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.621224 19869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e365a5ebb6d840dc8b1e88886fd89029. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.619437 19866 tablet_service.cc:1467] Processing CreateTablet for tablet 940723383ee8421fb6cb9a7281fdf8f9 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 14:17:00.623906 19865 tablet_service.cc:1467] Processing CreateTablet for tablet b56fffeac0494533a94ae337979bd8cb (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 14:17:00.624014 19864 tablet_service.cc:1467] Processing CreateTablet for tablet 1f56ac46a0754affa20b9aa5b917963c (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 14:17:00.626047 19867 tablet_service.cc:1467] Processing CreateTablet for tablet 67a0809e54dd4d4d86c3989974bf2519 (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 14:17:00.624719 19868 tablet_service.cc:1467] Processing CreateTablet for tablet f351b236cbf7446480345c0a126aad9d (DEFAULT_TABLE table=test-workload [id=a34ee5ab7ade4bb99050ccf8c528ccfd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 14:17:00.627015 19942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f351b236cbf7446480345c0a126aad9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.627687 19943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e365a5ebb6d840dc8b1e88886fd89029. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.629158 19870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 103f07eafa5e448fa7b87a06f341de95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.630741 19997 tablet_bootstrap.cc:654] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.630818 19867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67a0809e54dd4d4d86c3989974bf2519. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.632633 19866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 940723383ee8421fb6cb9a7281fdf8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.633136 19865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b56fffeac0494533a94ae337979bd8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.634094 19945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f48acad258464650873b115bf412c2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.634423 19864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f56ac46a0754affa20b9aa5b917963c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.636363 19868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f351b236cbf7446480345c0a126aad9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:00.711366 19998 tablet_bootstrap.cc:492] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.722893 19997 tablet_bootstrap.cc:492] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.725584 19997 ts_tablet_manager.cc:1367] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.146s user 0.008s sys 0.020s
I20240502 14:17:00.728804 20000 tablet_bootstrap.cc:492] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:00.729018 19997 raft_consensus.cc:348] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.729292 19997 raft_consensus.cc:374] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.730060 19997 raft_consensus.cc:729] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.730669 19997 consensus_queue.cc:260] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.731977 19998 tablet_bootstrap.cc:654] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.732714 20000 tablet_bootstrap.cc:654] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.734067 19833 heartbeater.cc:503] Master 127.18.176.62:41877 was elected leader, sending a full tablet report...
I20240502 14:17:00.734064 19997 ts_tablet_manager.cc:1398] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20240502 14:17:00.735738 19997 tablet_bootstrap.cc:492] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.738077 19997 tablet_bootstrap.cc:654] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.741236 19997 tablet_bootstrap.cc:492] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.741331 19998 tablet_bootstrap.cc:492] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.741488 19997 ts_tablet_manager.cc:1367] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20240502 14:17:00.741524 19998 ts_tablet_manager.cc:1367] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.004s
I20240502 14:17:00.742492 20000 tablet_bootstrap.cc:492] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:00.742698 20000 ts_tablet_manager.cc:1367] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.007s
I20240502 14:17:00.742627 19998 raft_consensus.cc:348] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.742947 19998 raft_consensus.cc:374] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.743105 19998 raft_consensus.cc:729] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.743697 20000 raft_consensus.cc:348] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.743408 19998 consensus_queue.cc:260] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.743903 20000 raft_consensus.cc:374] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.744017 20000 raft_consensus.cc:729] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.744447 20000 consensus_queue.cc:260] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.744772 19998 ts_tablet_manager.cc:1398] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240502 14:17:00.744923 19982 heartbeater.cc:503] Master 127.18.176.62:41877 was elected leader, sending a full tablet report...
I20240502 14:17:00.745111 19998 tablet_bootstrap.cc:492] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.745170 19997 raft_consensus.cc:348] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.745396 19997 raft_consensus.cc:374] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.745502 19997 raft_consensus.cc:729] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.745893 19997 consensus_queue.cc:260] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.747336 19997 ts_tablet_manager.cc:1398] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20240502 14:17:00.747756 19997 tablet_bootstrap.cc:492] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.749775 19997 tablet_bootstrap.cc:654] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.751188 19908 heartbeater.cc:503] Master 127.18.176.62:41877 was elected leader, sending a full tablet report...
I20240502 14:17:00.751196 20000 ts_tablet_manager.cc:1398] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20240502 14:17:00.751688 20000 tablet_bootstrap.cc:492] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:00.752521 19998 tablet_bootstrap.cc:654] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.761813 19997 tablet_bootstrap.cc:492] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.762065 19997 ts_tablet_manager.cc:1367] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20240502 14:17:00.762789 19998 tablet_bootstrap.cc:492] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.763006 19998 ts_tablet_manager.cc:1367] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20240502 14:17:00.763127 20000 tablet_bootstrap.cc:654] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.763181 19997 raft_consensus.cc:348] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.763520 19997 raft_consensus.cc:374] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.763643 19997 raft_consensus.cc:729] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.763907 19998 raft_consensus.cc:348] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.764003 19997 consensus_queue.cc:260] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.764137 19998 raft_consensus.cc:374] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.764207 19998 raft_consensus.cc:729] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.765158 19998 consensus_queue.cc:260] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.765796 19998 ts_tablet_manager.cc:1398] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:17:00.766117 19998 tablet_bootstrap.cc:492] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.764564 19997 ts_tablet_manager.cc:1398] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:00.768484 19998 tablet_bootstrap.cc:654] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.769490 19997 tablet_bootstrap.cc:492] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.772078 19997 tablet_bootstrap.cc:654] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.772459 20000 tablet_bootstrap.cc:492] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:00.772460 19998 tablet_bootstrap.cc:492] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.772713 19998 ts_tablet_manager.cc:1367] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240502 14:17:00.772717 20000 ts_tablet_manager.cc:1367] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.002s
I20240502 14:17:00.773772 19998 raft_consensus.cc:348] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.773847 20000 raft_consensus.cc:348] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.774067 19998 raft_consensus.cc:374] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.774119 20000 raft_consensus.cc:374] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.774196 19998 raft_consensus.cc:729] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.774221 20000 raft_consensus.cc:729] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.774554 19998 consensus_queue.cc:260] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.774554 20000 consensus_queue.cc:260] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.774780 19997 tablet_bootstrap.cc:492] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.774957 19997 ts_tablet_manager.cc:1367] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20240502 14:17:00.775177 20000 ts_tablet_manager.cc:1398] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:00.775208 19998 ts_tablet_manager.cc:1398] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:00.775542 19998 tablet_bootstrap.cc:492] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.775545 20000 tablet_bootstrap.cc:492] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:00.775810 19997 raft_consensus.cc:348] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.776026 19997 raft_consensus.cc:374] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.776111 19997 raft_consensus.cc:729] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.776399 19997 consensus_queue.cc:260] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.777582 19997 ts_tablet_manager.cc:1398] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:00.777653 20000 tablet_bootstrap.cc:654] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.777911 19998 tablet_bootstrap.cc:654] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.777936 19997 tablet_bootstrap.cc:492] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.779912 19997 tablet_bootstrap.cc:654] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.785671 19997 tablet_bootstrap.cc:492] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.785938 19997 ts_tablet_manager.cc:1367] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20240502 14:17:00.787179 19997 raft_consensus.cc:348] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.787467 19997 raft_consensus.cc:374] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.787582 19997 raft_consensus.cc:729] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.787917 19997 consensus_queue.cc:260] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.789680 19997 ts_tablet_manager.cc:1398] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 14:17:00.790073 19997 tablet_bootstrap.cc:492] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.792344 19997 tablet_bootstrap.cc:654] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.795377 19998 tablet_bootstrap.cc:492] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.795563 19998 ts_tablet_manager.cc:1367] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.007s
I20240502 14:17:00.795614 20000 tablet_bootstrap.cc:492] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:00.795771 20000 ts_tablet_manager.cc:1367] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.012s
I20240502 14:17:00.796330 19998 raft_consensus.cc:348] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.796543 19998 raft_consensus.cc:374] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.796465 20000 raft_consensus.cc:348] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.796624 19998 raft_consensus.cc:729] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.796694 20000 raft_consensus.cc:374] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.796792 20000 raft_consensus.cc:729] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.796911 19998 consensus_queue.cc:260] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.797047 20000 consensus_queue.cc:260] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.797453 19998 ts_tablet_manager.cc:1398] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:00.797809 19998 tablet_bootstrap.cc:492] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.798408 20000 ts_tablet_manager.cc:1398] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:17:00.798748 20000 tablet_bootstrap.cc:492] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:00.799649 19998 tablet_bootstrap.cc:654] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.800257 20006 raft_consensus.cc:482] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:00.800419 20006 raft_consensus.cc:504] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.801008 19997 tablet_bootstrap.cc:492] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.801348 19997 ts_tablet_manager.cc:1367] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20240502 14:17:00.802038 20006 leader_election.cc:288] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.802243 19997 raft_consensus.cc:348] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.802551 19997 raft_consensus.cc:374] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.802806 19997 raft_consensus.cc:729] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.803669 20000 tablet_bootstrap.cc:654] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.812242 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
W20240502 14:17:00.813369 19847 leader_election.cc:341] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.814311 19998 tablet_bootstrap.cc:492] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.814625 19998 ts_tablet_manager.cc:1367] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.010s
I20240502 14:17:00.815768 19998 raft_consensus.cc:348] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.816133 19998 raft_consensus.cc:374] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.816293 19998 raft_consensus.cc:729] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.816707 19998 consensus_queue.cc:260] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.818521 19998 ts_tablet_manager.cc:1398] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:00.819013 19998 tablet_bootstrap.cc:492] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.821228 19998 tablet_bootstrap.cc:654] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.824774 20001 raft_consensus.cc:482] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:00.824993 20001 raft_consensus.cc:504] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.826470 20001 leader_election.cc:288] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.837553 19997 consensus_queue.cc:260] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.841605 19997 ts_tablet_manager.cc:1398] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20240502 14:17:00.842154 19997 tablet_bootstrap.cc:492] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.865242 19997 tablet_bootstrap.cc:654] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.871598 19957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:00.872279 19957 raft_consensus.cc:2454] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 0.
I20240502 14:17:00.872946 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f48acad258464650873b115bf412c2e8" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:00.873376 19883 raft_consensus.cc:2454] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 0.
I20240502 14:17:00.874069 19772 leader_election.cc:302] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:00.874491 20001 raft_consensus.cc:2781] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:00.874814 20001 raft_consensus.cc:482] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:00.874951 20001 raft_consensus.cc:3037] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.879549 20001 raft_consensus.cc:504] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.881402 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f48acad258464650873b115bf412c2e8" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:00.881711 19883 raft_consensus.cc:3037] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.891300 19883 raft_consensus.cc:2454] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 1.
I20240502 14:17:00.891957 19772 leader_election.cc:302] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:00.892760 19957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f48acad258464650873b115bf412c2e8" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:00.892807 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f48acad258464650873b115bf412c2e8" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:00.893253 20001 leader_election.cc:288] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.893527 20001 raft_consensus.cc:2781] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:00.893680 20001 raft_consensus.cc:686] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
W20240502 14:17:00.893813 19774 leader_election.cc:341] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:00.894287 19774 leader_election.cc:341] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.894083 20001 consensus_queue.cc:237] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.899029 19849 leader_election.cc:302] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:00.899567 20006 raft_consensus.cc:2781] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:00.899745 20006 raft_consensus.cc:482] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:00.899842 20006 raft_consensus.cc:3037] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.903672 20006 raft_consensus.cc:504] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.904716 20006 leader_election.cc:288] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.905150 19998 tablet_bootstrap.cc:492] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.905336 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:00.905431 19998 ts_tablet_manager.cc:1367] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.086s user 0.040s sys 0.040s
W20240502 14:17:00.906054 19847 leader_election.cc:341] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.906373 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:00.906469 19998 raft_consensus.cc:348] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.906661 19956 raft_consensus.cc:3037] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.906752 19998 raft_consensus.cc:374] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.906857 20000 tablet_bootstrap.cc:492] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:00.906869 19998 raft_consensus.cc:729] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.907089 20000 ts_tablet_manager.cc:1367] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.108s user 0.047s sys 0.052s
I20240502 14:17:00.907284 19998 consensus_queue.cc:260] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.907912 20000 raft_consensus.cc:348] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.908061 19998 ts_tablet_manager.cc:1398] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:00.908167 20000 raft_consensus.cc:374] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.908262 20000 raft_consensus.cc:729] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.908433 19998 tablet_bootstrap.cc:492] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.908623 20000 consensus_queue.cc:260] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.909981 19956 raft_consensus.cc:2454] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 1.
I20240502 14:17:00.910252 20000 ts_tablet_manager.cc:1398] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 14:17:00.910418 19998 tablet_bootstrap.cc:654] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.911368 20000 tablet_bootstrap.cc:492] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:00.911569 19703 catalog_manager.cc:5484] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 1 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:00.913203 19997 tablet_bootstrap.cc:492] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.913372 20000 tablet_bootstrap.cc:654] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.913424 19997 ts_tablet_manager.cc:1367] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.071s user 0.015s sys 0.015s
I20240502 14:17:00.914482 19997 raft_consensus.cc:348] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.914789 19997 raft_consensus.cc:374] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.914891 19997 raft_consensus.cc:729] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.915222 19997 consensus_queue.cc:260] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.915899 19997 ts_tablet_manager.cc:1398] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:00.916307 19997 tablet_bootstrap.cc:492] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.919068 19997 tablet_bootstrap.cc:654] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.919104 19998 tablet_bootstrap.cc:492] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.919312 19998 ts_tablet_manager.cc:1367] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20240502 14:17:00.920326 19998 raft_consensus.cc:348] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.920606 19998 raft_consensus.cc:374] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.920701 19998 raft_consensus.cc:729] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.921025 19998 consensus_queue.cc:260] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.921820 19998 ts_tablet_manager.cc:1398] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:00.922214 19998 tablet_bootstrap.cc:492] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.923509 20023 raft_consensus.cc:482] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:00.923691 20023 raft_consensus.cc:504] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.924465 19998 tablet_bootstrap.cc:654] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.924708 20023 leader_election.cc:288] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.926508 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:00.926843 19956 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 0.
I20240502 14:17:00.927476 19774 leader_election.cc:302] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:00.927536 19849 leader_election.cc:302] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:00.928246 20006 raft_consensus.cc:2781] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:00.927940 20001 raft_consensus.cc:2781] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:00.928519 20001 raft_consensus.cc:482] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:00.928714 20001 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.929765 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:00.930406 19998 tablet_bootstrap.cc:492] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
W20240502 14:17:00.930397 19772 leader_election.cc:341] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.930881 19998 ts_tablet_manager.cc:1367] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20240502 14:17:00.931681 19998 raft_consensus.cc:348] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.931902 19998 raft_consensus.cc:374] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.931998 19998 raft_consensus.cc:729] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.932173 20023 raft_consensus.cc:482] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:00.932279 19998 consensus_queue.cc:260] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.932536 20001 raft_consensus.cc:504] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.932900 19998 ts_tablet_manager.cc:1398] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:00.932368 20023 raft_consensus.cc:504] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.933913 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:00.933945 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:00.934218 19956 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.934303 20023 leader_election.cc:288] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
W20240502 14:17:00.934700 19772 leader_election.cc:341] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.935271 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:00.935886 19998 tablet_bootstrap.cc:492] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
W20240502 14:17:00.935914 19772 leader_election.cc:341] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.936990 19997 tablet_bootstrap.cc:492] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.937243 19997 ts_tablet_manager.cc:1367] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20240502 14:17:00.938020 19998 tablet_bootstrap.cc:654] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.938448 19997 raft_consensus.cc:348] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.938894 19997 raft_consensus.cc:374] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.939039 19997 raft_consensus.cc:729] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.939121 19957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:00.939391 19957 raft_consensus.cc:2454] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 0.
I20240502 14:17:00.939615 19997 consensus_queue.cc:260] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.940408 19997 ts_tablet_manager.cc:1398] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:00.940922 19774 leader_election.cc:302] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:00.943286 20023 raft_consensus.cc:2781] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:00.943446 20023 raft_consensus.cc:482] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:00.943516 19956 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 1.
I20240502 14:17:00.943817 20023 raft_consensus.cc:3037] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.944075 19774 leader_election.cc:302] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:00.947722 20023 raft_consensus.cc:504] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.949398 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
W20240502 14:17:00.950111 19772 leader_election.cc:341] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:00.943610 20001 leader_election.cc:288] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.950749 20023 leader_election.cc:288] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:00.950865 20001 raft_consensus.cc:2781] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:00.943372 19997 tablet_bootstrap.cc:492] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.951073 20001 raft_consensus.cc:686] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:00.951820 20001 consensus_queue.cc:237] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.952042 20005 raft_consensus.cc:482] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:00.952198 20005 raft_consensus.cc:504] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.953285 20005 leader_election.cc:288] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:00.954288 19997 tablet_bootstrap.cc:654] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.955821 20006 raft_consensus.cc:686] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:00.956192 20006 consensus_queue.cc:237] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.958053 19998 tablet_bootstrap.cc:492] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:00.958253 19998 ts_tablet_manager.cc:1367] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.005s
I20240502 14:17:00.959277 19998 raft_consensus.cc:348] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.959563 19998 raft_consensus.cc:374] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.959681 19998 raft_consensus.cc:729] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.959981 19998 consensus_queue.cc:260] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.961277 19997 tablet_bootstrap.cc:492] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:00.961457 19998 ts_tablet_manager.cc:1398] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240502 14:17:00.961578 19997 ts_tablet_manager.cc:1367] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.004s
I20240502 14:17:00.961831 19998 tablet_bootstrap.cc:492] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31: Bootstrap starting.
I20240502 14:17:00.962638 19997 raft_consensus.cc:348] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.963127 19997 raft_consensus.cc:374] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.963330 20000 tablet_bootstrap.cc:492] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:00.963510 20000 ts_tablet_manager.cc:1367] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.053s user 0.014s sys 0.010s
I20240502 14:17:00.963294 19997 raft_consensus.cc:729] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.963891 19998 tablet_bootstrap.cc:654] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.963891 19997 consensus_queue.cc:260] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.964702 19997 ts_tablet_manager.cc:1398] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:00.965322 19997 tablet_bootstrap.cc:492] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d: Bootstrap starting.
I20240502 14:17:00.965535 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2888d23ddf87436199097249d3376f51" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:00.965818 19808 raft_consensus.cc:2454] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 0.
I20240502 14:17:00.965821 20000 raft_consensus.cc:348] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.966076 20000 raft_consensus.cc:374] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:00.966192 20000 raft_consensus.cc:729] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:00.966463 20000 consensus_queue.cc:260] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.966682 19921 leader_election.cc:302] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:00.966977 20005 raft_consensus.cc:2781] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:00.967111 20005 raft_consensus.cc:482] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:00.967268 20005 raft_consensus.cc:3037] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.970893 20000 ts_tablet_manager.cc:1398] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240502 14:17:00.971279 20000 tablet_bootstrap.cc:492] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:00.971829 20005 raft_consensus.cc:504] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.972827 20005 leader_election.cc:288] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:00.973655 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2888d23ddf87436199097249d3376f51" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:00.973918 19808 raft_consensus.cc:3037] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.974856 19997 tablet_bootstrap.cc:654] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.976508 20000 tablet_bootstrap.cc:654] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:00.977461 19808 raft_consensus.cc:2454] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 1.
I20240502 14:17:00.978055 19921 leader_election.cc:302] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:00.978518 20005 raft_consensus.cc:2781] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:00.984800 20005 raft_consensus.cc:686] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:00.985306 20005 consensus_queue.cc:237] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.987823 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:00.988176 19956 raft_consensus.cc:3037] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:00.991752 19956 raft_consensus.cc:2454] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 1.
I20240502 14:17:00.992393 19774 leader_election.cc:302] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:00.992858 20031 raft_consensus.cc:2781] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:00.993070 20031 raft_consensus.cc:686] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:00.993445 20031 consensus_queue.cc:237] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.996733 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2888d23ddf87436199097249d3376f51" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:00.996856 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2888d23ddf87436199097249d3376f51" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:00.997119 19883 raft_consensus.cc:2454] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 0.
I20240502 14:17:00.997584 20031 raft_consensus.cc:482] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:00.997787 20031 raft_consensus.cc:504] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:00.999650 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
W20240502 14:17:01.000607 19772 leader_election.cc:341] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:01.001132 20031 leader_election.cc:288] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.002305 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.002630 19956 raft_consensus.cc:2454] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 0.
I20240502 14:17:01.003165 19774 leader_election.cc:302] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.003556 20031 raft_consensus.cc:2781] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:01.003669 20031 raft_consensus.cc:482] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:01.003787 20031 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.007464 20031 raft_consensus.cc:504] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.009083 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
W20240502 14:17:01.009800 19772 leader_election.cc:341] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:01.010319 20031 leader_election.cc:288] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.011325 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.011582 19956 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.014204 19705 catalog_manager.cc:5484] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 1 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:01.015709 19956 raft_consensus.cc:2454] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 1.
I20240502 14:17:01.016196 19774 leader_election.cc:302] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.018139 20031 raft_consensus.cc:2781] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:01.018347 20031 raft_consensus.cc:686] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:01.018730 20031 consensus_queue.cc:237] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.023315 19705 catalog_manager.cc:5484] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 1 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.029090 19997 tablet_bootstrap.cc:492] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d: No bootstrap required, opened a new log
I20240502 14:17:01.029402 19998 tablet_bootstrap.cc:492] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31: No bootstrap required, opened a new log
I20240502 14:17:01.029413 19997 ts_tablet_manager.cc:1367] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent bootstrapping tablet: real 0.064s user 0.021s sys 0.023s
I20240502 14:17:01.029596 19998 ts_tablet_manager.cc:1367] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31: Time spent bootstrapping tablet: real 0.068s user 0.046s sys 0.019s
I20240502 14:17:01.030665 19998 raft_consensus.cc:348] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.030992 19998 raft_consensus.cc:374] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.030725 19705 catalog_manager.cc:5484] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 1 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.031109 19998 raft_consensus.cc:729] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.031414 19998 consensus_queue.cc:260] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.031301 19703 catalog_manager.cc:5484] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.031668 20000 tablet_bootstrap.cc:492] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:01.031420 19705 catalog_manager.cc:5484] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 1 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.031843 20000 ts_tablet_manager.cc:1367] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.009s
I20240502 14:17:01.032677 20000 raft_consensus.cc:348] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.032881 19998 ts_tablet_manager.cc:1398] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:01.032907 20000 raft_consensus.cc:374] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.033031 20000 raft_consensus.cc:729] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.033342 20000 consensus_queue.cc:260] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.034422 19997 raft_consensus.cc:348] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.034991 19997 raft_consensus.cc:374] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.035151 19997 raft_consensus.cc:729] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.035600 19997 consensus_queue.cc:260] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.036044 20031 raft_consensus.cc:482] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.036199 20031 raft_consensus.cc:504] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.036725 20005 raft_consensus.cc:482] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.036842 20000 ts_tablet_manager.cc:1398] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 14:17:01.036923 20031 leader_election.cc:288] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.037379 20005 raft_consensus.cc:504] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.037736 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:01.038019 20005 leader_election.cc:288] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:01.038179 20000 tablet_bootstrap.cc:492] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:01.038265 19997 ts_tablet_manager.cc:1398] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20240502 14:17:01.038318 19772 leader_election.cc:341] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:01.039084 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:01.039225 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.039314 19882 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 0.
I20240502 14:17:01.039475 19808 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 0.
I20240502 14:17:01.039921 19921 leader_election.cc:302] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.040248 20000 tablet_bootstrap.cc:654] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:01.040485 20005 raft_consensus.cc:2781] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:01.040623 20005 raft_consensus.cc:482] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:01.040740 20005 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.042421 20000 tablet_bootstrap.cc:492] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:01.042649 20000 ts_tablet_manager.cc:1367] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 14:17:01.043598 20000 raft_consensus.cc:348] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.043694 20005 raft_consensus.cc:504] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.043844 20000 raft_consensus.cc:374] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.043953 20000 raft_consensus.cc:729] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.044207 20000 consensus_queue.cc:260] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.044431 20005 leader_election.cc:288] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:01.045203 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.045444 19808 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.045830 20000 ts_tablet_manager.cc:1398] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:01.046200 20000 tablet_bootstrap.cc:492] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:01.048731 19808 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 1.
I20240502 14:17:01.049278 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:01.049544 19882 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.049587 20000 tablet_bootstrap.cc:654] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:01.050797 19921 leader_election.cc:302] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.051287 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.051645 19956 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 0.
I20240502 14:17:01.052100 19774 leader_election.cc:302] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.052410 20000 tablet_bootstrap.cc:492] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:01.052418 20031 raft_consensus.cc:2781] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:01.052598 20031 raft_consensus.cc:482] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:01.052645 20000 ts_tablet_manager.cc:1367] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20240502 14:17:01.052678 20031 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.052762 19882 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 1.
I20240502 14:17:01.053903 20005 raft_consensus.cc:2781] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:01.054134 20005 raft_consensus.cc:686] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:01.053898 20000 raft_consensus.cc:348] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.054849 20000 raft_consensus.cc:374] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.055002 20000 raft_consensus.cc:729] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.054852 20005 consensus_queue.cc:237] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.055306 20000 consensus_queue.cc:260] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.055918 20000 ts_tablet_manager.cc:1398] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20240502 14:17:01.056334 20000 tablet_bootstrap.cc:492] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:01.057101 20031 raft_consensus.cc:504] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.058610 20000 tablet_bootstrap.cc:654] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:01.058825 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
W20240502 14:17:01.060501 19772 leader_election.cc:341] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:01.061116 20031 leader_election.cc:288] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.061370 20000 tablet_bootstrap.cc:492] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:01.061558 20000 ts_tablet_manager.cc:1367] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 14:17:01.061637 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.061892 19956 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.062502 20000 raft_consensus.cc:348] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.062847 20000 raft_consensus.cc:374] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.062979 20000 raft_consensus.cc:729] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.062551 19704 catalog_manager.cc:5484] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 1 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:01.063287 20000 consensus_queue.cc:260] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.064749 20000 ts_tablet_manager.cc:1398] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240502 14:17:01.064996 19956 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 1.
I20240502 14:17:01.065093 20000 tablet_bootstrap.cc:492] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: Bootstrap starting.
I20240502 14:17:01.066100 19774 leader_election.cc:302] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters: e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.066462 20031 raft_consensus.cc:2781] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:01.066669 20031 raft_consensus.cc:686] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:01.066931 20031 consensus_queue.cc:237] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.067260 20000 tablet_bootstrap.cc:654] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:01.069623 20000 tablet_bootstrap.cc:492] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: No bootstrap required, opened a new log
I20240502 14:17:01.069810 20000 ts_tablet_manager.cc:1367] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 14:17:01.070696 20000 raft_consensus.cc:348] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.070984 20000 raft_consensus.cc:374] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:01.071091 20000 raft_consensus.cc:729] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Initialized, Role: FOLLOWER
I20240502 14:17:01.071365 20000 consensus_queue.cc:260] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.071318 19704 catalog_manager.cc:5484] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 1 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.071966 20000 ts_tablet_manager.cc:1398] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:01.098863 20005 raft_consensus.cc:482] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.099136 20005 raft_consensus.cc:504] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.099936 20005 leader_election.cc:288] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:01.100559 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.100611 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:01.100785 19808 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 0.
I20240502 14:17:01.100811 19882 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 0.
I20240502 14:17:01.101228 19921 leader_election.cc:302] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.101508 20005 raft_consensus.cc:2781] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:01.101652 20005 raft_consensus.cc:482] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:01.101737 20005 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.103904 20005 raft_consensus.cc:504] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.104578 20005 leader_election.cc:288] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:01.105268 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:01.105315 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.105571 19808 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.105576 19882 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.109164 19882 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 1.
I20240502 14:17:01.109143 19808 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 1.
I20240502 14:17:01.109776 19921 leader_election.cc:302] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.110132 20005 raft_consensus.cc:2781] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:01.110299 20005 raft_consensus.cc:686] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:01.110680 20005 consensus_queue.cc:237] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.113729 19705 catalog_manager.cc:5484] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 1 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:01.175124 20006 raft_consensus.cc:482] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.175423 20006 raft_consensus.cc:504] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.176172 20006 leader_election.cc:288] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.176849 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.176856 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.177130 19956 raft_consensus.cc:2379] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7ad344eaca649949d0b8ca36f87f068 in current term 1: Already voted for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in this term.
I20240502 14:17:01.177579 19849 leader_election.cc:302] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.177906 20006 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.180135 20006 raft_consensus.cc:2726] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:01.200913 20006 raft_consensus.cc:482] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.201195 20006 raft_consensus.cc:504] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.202009 20006 leader_election.cc:288] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.202695 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.202756 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.203249 19956 raft_consensus.cc:2379] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7ad344eaca649949d0b8ca36f87f068 in current term 1: Already voted for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in this term.
I20240502 14:17:01.203832 19849 leader_election.cc:302] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.204169 20006 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.206275 20006 raft_consensus.cc:2726] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:01.211953 20005 raft_consensus.cc:482] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.212227 20005 raft_consensus.cc:504] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.212924 20005 leader_election.cc:288] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:01.213636 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f48acad258464650873b115bf412c2e8" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.213634 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f48acad258464650873b115bf412c2e8" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:01.213989 19882 raft_consensus.cc:2379] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f20ea149e0a049829dc1d8810f7a5e31 in current term 1: Already voted for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in this term.
I20240502 14:17:01.214391 19921 leader_election.cc:302] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f20ea149e0a049829dc1d8810f7a5e31; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.214771 20005 raft_consensus.cc:3037] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.217177 20005 raft_consensus.cc:2726] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:01.274813 20031 raft_consensus.cc:482] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.275104 20031 raft_consensus.cc:504] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.275831 20031 leader_election.cc:288] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.276458 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7ad344eaca649949d0b8ca36f87f068" is_pre_election: true
I20240502 14:17:01.276465 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.276765 19956 raft_consensus.cc:2379] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57b01b1ad13f4b39ad2d0220817eaa0d in current term 1: Already voted for candidate e7ad344eaca649949d0b8ca36f87f068 in this term.
I20240502 14:17:01.277252 19774 leader_election.cc:302] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d; no voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.277575 20031 raft_consensus.cc:3037] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.279724 20031 raft_consensus.cc:2726] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 14:17:01.339880 19754 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:17:01.340850 20006 raft_consensus.cc:482] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.341073 20006 raft_consensus.cc:504] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.341847 20006 leader_election.cc:288] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.342401 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b56fffeac0494533a94ae337979bd8cb" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.342440 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b56fffeac0494533a94ae337979bd8cb" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.342651 19808 raft_consensus.cc:2454] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 0.
I20240502 14:17:01.342710 19956 raft_consensus.cc:2454] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 0.
I20240502 14:17:01.343092 19847 leader_election.cc:302] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:01.343391 20006 raft_consensus.cc:2781] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:01.343500 20006 raft_consensus.cc:482] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:01.343593 20006 raft_consensus.cc:3037] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.345642 20006 raft_consensus.cc:504] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.346395 20006 leader_election.cc:288] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.347033 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b56fffeac0494533a94ae337979bd8cb" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.347072 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b56fffeac0494533a94ae337979bd8cb" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.347288 19808 raft_consensus.cc:3037] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.347285 19956 raft_consensus.cc:3037] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.350570 19956 raft_consensus.cc:2454] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 1.
I20240502 14:17:01.350557 19808 raft_consensus.cc:2454] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 1.
I20240502 14:17:01.351229 19849 leader_election.cc:302] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.351609 20006 raft_consensus.cc:2781] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:01.351797 20006 raft_consensus.cc:686] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:01.352102 20006 consensus_queue.cc:237] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.355180 19705 catalog_manager.cc:5484] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.389120 20006 raft_consensus.cc:482] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.389360 20006 raft_consensus.cc:504] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.390080 20006 leader_election.cc:288] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.390493 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.390494 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.390620 20031 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.390864 19956 raft_consensus.cc:2379] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7ad344eaca649949d0b8ca36f87f068 in current term 1: Already voted for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in this term.
I20240502 14:17:01.391301 19849 leader_election.cc:302] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.391608 20006 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.394848 20006 raft_consensus.cc:2726] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:01.398181 20031 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.420984 20006 raft_consensus.cc:482] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:01.421279 20006 raft_consensus.cc:504] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.422029 20006 leader_election.cc:288] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.422191 19882 raft_consensus.cc:3037] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.422487 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" is_pre_election: true
I20240502 14:17:01.422561 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31" is_pre_election: true
I20240502 14:17:01.422911 19956 raft_consensus.cc:2379] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7ad344eaca649949d0b8ca36f87f068 in current term 1: Already voted for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in this term.
I20240502 14:17:01.423342 19849 leader_election.cc:302] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068; no voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.423714 20006 raft_consensus.cc:3037] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:01.425724 20005 consensus_queue.cc:1035] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.426112 20006 raft_consensus.cc:2726] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:01.430830 20005 consensus_queue.cc:1035] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.431412 20006 consensus_queue.cc:1035] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.440470 20006 consensus_queue.cc:1035] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.443506 20005 consensus_queue.cc:1035] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.450520 20005 consensus_queue.cc:1035] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.459460 20031 consensus_queue.cc:1035] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.464241 20001 consensus_queue.cc:1035] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.481670 19956 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2888d23ddf87436199097249d3376f51"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
mode: GRACEFUL
new_leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:55842
I20240502 14:17:01.481997 19956 raft_consensus.cc:595] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Received request to transfer leadership to TS 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:01.482123 20001 consensus_queue.cc:1035] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.484794 19956 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
mode: GRACEFUL
new_leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:55842
I20240502 14:17:01.485131 19956 raft_consensus.cc:595] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Received request to transfer leadership to TS 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:01.487849 20031 consensus_queue.cc:1035] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.490764 20031 consensus_queue.cc:1035] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.499053 20023 consensus_queue.cc:1035] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.516919 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:35598
I20240502 14:17:01.517235 19807 raft_consensus.cc:595] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Received request to transfer leadership to TS e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.520134 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:35598
I20240502 14:17:01.520398 19807 raft_consensus.cc:595] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Received request to transfer leadership to TS e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.522876 19956 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
mode: GRACEFUL
new_leader_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:55842
I20240502 14:17:01.523149 19956 raft_consensus.cc:595] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Received request to transfer leadership to TS e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:01.532822 19882 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
mode: GRACEFUL
new_leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:56298
I20240502 14:17:01.533175 19882 raft_consensus.cc:595] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Received request to transfer leadership to TS f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.628369 20023 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.631417 20001 raft_consensus.cc:979] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:01.631704 20001 raft_consensus.cc:1067] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Signalling peer e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:01.632534 19883 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:56286
I20240502 14:17:01.632798 19883 raft_consensus.cc:482] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:01.632954 19883 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.635416 20001 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.635663 19883 raft_consensus.cc:504] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.636919 19957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.636984 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.637280 19807 raft_consensus.cc:3032] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:01.637431 19807 raft_consensus.cc:729] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:01.637513 19883 leader_election.cc:288] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 2 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.637776 19807 consensus_queue.cc:260] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.638286 19807 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.641494 19807 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 2.
I20240502 14:17:01.642046 19847 leader_election.cc:302] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters: f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:01.642462 20059 raft_consensus.cc:2781] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:01.642704 20059 raft_consensus.cc:686] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:01.643121 20059 consensus_queue.cc:237] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.645718 19703 catalog_manager.cc:5484] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 1 to 2, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.701727 20056 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.702100 20005 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.707195 20056 raft_consensus.cc:979] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: : Instructing follower e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:01.707413 20056 raft_consensus.cc:1067] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Signalling peer e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:01.710081 19882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:56296
I20240502 14:17:01.710376 19882 raft_consensus.cc:482] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:01.710549 19882 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.713140 19882 raft_consensus.cc:504] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.713891 19882 leader_election.cc:288] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 2 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.714784 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.714803 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.715044 19956 raft_consensus.cc:3032] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:01.715106 19807 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.715154 19956 raft_consensus.cc:729] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:01.715468 19956 consensus_queue.cc:260] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.715829 19956 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.718015 19807 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 2.
I20240502 14:17:01.718107 19956 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 2.
I20240502 14:17:01.718601 19849 leader_election.cc:302] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.718924 20059 raft_consensus.cc:2781] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:01.719115 20059 raft_consensus.cc:686] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:01.719385 20059 consensus_queue.cc:237] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.722048 19704 catalog_manager.cc:5484] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 1 to 2, leader changed from f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3) to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.830993 20029 raft_consensus.cc:979] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: : Instructing follower f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:01.831214 20029 raft_consensus.cc:1067] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Signalling peer f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:01.832007 19956 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:55818
I20240502 14:17:01.832257 19956 raft_consensus.cc:482] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:01.832376 19956 raft_consensus.cc:3037] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.834751 19956 raft_consensus.cc:504] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.835562 19956 leader_election.cc:288] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 2 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:01.836162 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.836242 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f56ac46a0754affa20b9aa5b917963c" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:01.836421 19807 raft_consensus.cc:3037] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.836498 19882 raft_consensus.cc:3032] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:01.836627 19882 raft_consensus.cc:729] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:01.836947 19882 consensus_queue.cc:260] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.837409 19882 raft_consensus.cc:3037] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.838886 19807 raft_consensus.cc:2454] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 2.
I20240502 14:17:01.839489 19921 leader_election.cc:302] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.839833 20056 raft_consensus.cc:2781] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:01.840059 20056 raft_consensus.cc:686] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:01.840057 19882 raft_consensus.cc:2454] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 2.
I20240502 14:17:01.840483 20056 consensus_queue.cc:237] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.843541 19704 catalog_manager.cc:5484] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 1 to 2, leader changed from e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2) to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 2 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:01.887295 20005 raft_consensus.cc:979] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: : Instructing follower 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:01.887547 20005 raft_consensus.cc:1067] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Signalling peer 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:01.888468 19807 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2888d23ddf87436199097249d3376f51"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:35596
I20240502 14:17:01.888700 19807 raft_consensus.cc:482] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:01.888865 19807 raft_consensus.cc:3037] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.891109 19807 raft_consensus.cc:504] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.891867 19807 leader_election.cc:288] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 2 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.892503 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2888d23ddf87436199097249d3376f51" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.892477 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2888d23ddf87436199097249d3376f51" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:01.892788 19956 raft_consensus.cc:3032] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:01.892791 19882 raft_consensus.cc:3037] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.892951 19956 raft_consensus.cc:729] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:01.893290 19956 consensus_queue.cc:260] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.893791 19956 raft_consensus.cc:3037] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.896355 19882 raft_consensus.cc:2454] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 2.
I20240502 14:17:01.896768 19956 raft_consensus.cc:2454] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 2.
I20240502 14:17:01.897055 19772 leader_election.cc:302] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:01.897424 20001 raft_consensus.cc:2781] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:01.897590 20001 raft_consensus.cc:686] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:01.897972 20001 consensus_queue.cc:237] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.901029 20001 raft_consensus.cc:979] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:01.901223 20001 raft_consensus.cc:1067] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Signalling peer e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:01.900827 19704 catalog_manager.cc:5484] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 1 to 2, leader changed from f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3) to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 2 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.902065 19882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:56286
I20240502 14:17:01.902344 19882 raft_consensus.cc:482] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:01.902581 19882 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.905287 20029 consensus_queue.cc:1035] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:01.906013 19882 raft_consensus.cc:504] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.907469 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:01.908346 19808 raft_consensus.cc:3032] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:01.908470 19808 raft_consensus.cc:729] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:01.908757 19882 leader_election.cc:288] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 2 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.908967 19808 consensus_queue.cc:260] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.909399 19808 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.908802 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:01.910460 19956 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.913887 19808 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 2.
I20240502 14:17:01.913957 19956 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 2.
I20240502 14:17:01.914507 19849 leader_election.cc:302] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:01.915787 20029 raft_consensus.cc:2781] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:01.916030 20029 raft_consensus.cc:686] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:01.916396 20029 consensus_queue.cc:237] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.917532 20059 consensus_queue.cc:1035] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240502 14:17:01.920007 19704 catalog_manager.cc:5484] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 1 to 2, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 2 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:01.994182 20056 raft_consensus.cc:979] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: : Instructing follower 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:01.994372 20056 raft_consensus.cc:1067] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Signalling peer 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:01.995201 19808 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:35596
I20240502 14:17:01.995584 19808 raft_consensus.cc:482] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:01.995692 19808 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.997871 19808 raft_consensus.cc:504] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:01.998678 19808 leader_election.cc:288] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 2 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:01.999356 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:01.999606 19882 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:01.999521 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:02.000012 19956 raft_consensus.cc:3032] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:02.000136 19956 raft_consensus.cc:729] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:02.000496 19956 consensus_queue.cc:260] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:02.000972 19956 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:02.002259 19882 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 2.
I20240502 14:17:02.002801 19772 leader_election.cc:302] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:02.003132 20001 raft_consensus.cc:2781] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:02.003336 20001 raft_consensus.cc:686] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:02.003561 19956 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 2.
I20240502 14:17:02.003659 20001 consensus_queue.cc:237] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:02.006294 19704 catalog_manager.cc:5484] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 1 to 2, leader changed from f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3) to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 2 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:02.099145 19956 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:02.102326 19956 raft_consensus.cc:1261] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.103121 20059 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.106873 19808 raft_consensus.cc:1261] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.107841 20029 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.235482 19956 raft_consensus.cc:1261] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.235901 19808 raft_consensus.cc:1261] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.236148 20029 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.236482 20059 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.244529 19808 raft_consensus.cc:1261] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.245095 20056 consensus_queue.cc:1035] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.248503 19882 raft_consensus.cc:1261] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.249387 20038 consensus_queue.cc:1035] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.391914 19882 raft_consensus.cc:1261] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.392557 20001 consensus_queue.cc:1035] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.397017 19956 raft_consensus.cc:1261] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.397650 20001 consensus_queue.cc:1035] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.411738 19808 raft_consensus.cc:1261] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.412348 20079 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.415817 19956 raft_consensus.cc:1261] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.416712 20059 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.417387 19882 raft_consensus.cc:1261] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.417975 20001 consensus_queue.cc:1035] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:02.421586 19956 raft_consensus.cc:1261] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:02.422219 20023 consensus_queue.cc:1035] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:04.546427 19136 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240502 14:17:04.546789 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:04.556104 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:35604
I20240502 14:17:04.556356 19807 raft_consensus.cc:595] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Received request to transfer leadership to TS f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:04.562814 19882 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
mode: GRACEFUL
new_leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:56302
I20240502 14:17:04.563089 19882 raft_consensus.cc:595] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Received request to transfer leadership to TS f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:04.563670 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240502 14:17:04.563925 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:04.743904 20082 raft_consensus.cc:979] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:04.744076 20082 raft_consensus.cc:1067] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Signalling peer f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:04.744652 19956 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:55834
I20240502 14:17:04.744855 19956 raft_consensus.cc:482] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:04.744959 19956 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:04.747120 19956 raft_consensus.cc:504] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:04.747777 19956 leader_election.cc:288] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 2 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:04.748304 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:04.748333 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:04.748504 19807 raft_consensus.cc:3032] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:04.748538 19882 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:04.748620 19807 raft_consensus.cc:729] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:04.748924 19807 consensus_queue.cc:260] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:04.749280 19807 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:04.750981 19882 raft_consensus.cc:2454] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 2.
I20240502 14:17:04.751423 19807 raft_consensus.cc:2454] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 2.
I20240502 14:17:04.751540 19921 leader_election.cc:302] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:04.751868 20038 raft_consensus.cc:2781] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:04.752326 20038 raft_consensus.cc:686] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:04.752612 20038 consensus_queue.cc:237] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:04.755415 19705 catalog_manager.cc:5484] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 1 to 2, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 2 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:04.960311 20059 raft_consensus.cc:979] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: : Instructing follower f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:04.960494 20059 raft_consensus.cc:1067] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Signalling peer f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:04.961192 19957 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:55818
I20240502 14:17:04.961409 19957 raft_consensus.cc:482] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:04.961534 19957 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:04.963694 19957 raft_consensus.cc:504] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:04.964414 19957 leader_election.cc:288] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 3 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:04.964982 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:04.964968 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:04.965257 19807 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:04.965283 19882 raft_consensus.cc:3032] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:17:04.965395 19882 raft_consensus.cc:729] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:04.965749 19882 consensus_queue.cc:260] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:04.966157 19882 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:04.968472 19807 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 3.
I20240502 14:17:04.968911 19882 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 3.
I20240502 14:17:04.969028 19921 leader_election.cc:302] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:04.969384 20038 raft_consensus.cc:2781] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:17:04.969560 20038 raft_consensus.cc:686] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:04.969877 20038 consensus_queue.cc:237] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:04.972692 19705 catalog_manager.cc:5484] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 2 to 3, leader changed from e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2) to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 3 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:05.157457 19882 raft_consensus.cc:1261] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:05.158118 20038 consensus_queue.cc:1035] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:05.162447 19807 raft_consensus.cc:1261] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:05.163205 20038 consensus_queue.cc:1035] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:05.529877 19807 raft_consensus.cc:1261] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:05.530709 20038 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:05.535007 19882 raft_consensus.cc:1261] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:05.538365 20038 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:05.564359 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:05.566319 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:05.566624 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:06.567303 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:06.569440 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:06.569705 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:07.570307 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:07.572275 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:07.572531 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:08.573112 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:08.575117 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:08.575362 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:09.575850 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:09.577680 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:09.577937 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:10.578500 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:10.580407 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:10.580653 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:11.581085 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:11.584225 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:11.584539 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:12.585080 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:12.587181 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:12.587723 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:13.588258 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:13.590366 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:13.590672 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:14.605485 19136 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240502 14:17:14.613344 19956 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
mode: GRACEFUL
new_leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:55842
I20240502 14:17:14.613605 19956 raft_consensus.cc:595] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Received request to transfer leadership to TS 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:14.617122 19956 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
mode: GRACEFUL
new_leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:55842
I20240502 14:17:14.617385 19956 raft_consensus.cc:595] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Received request to transfer leadership to TS 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:14.620316 19883 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
mode: GRACEFUL
new_leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:56298
I20240502 14:17:14.620579 19883 raft_consensus.cc:595] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Received request to transfer leadership to TS 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:14.622979 19883 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
mode: GRACEFUL
new_leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:56298
I20240502 14:17:14.623246 19883 raft_consensus.cc:595] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Received request to transfer leadership to TS 57b01b1ad13f4b39ad2d0220817eaa0d
I20240502 14:17:14.661180 20116 raft_consensus.cc:979] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: : Instructing follower 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.661357 20116 raft_consensus.cc:1067] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Signalling peer 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.662282 19807 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:35586
I20240502 14:17:14.662597 19807 raft_consensus.cc:482] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:14.662739 19807 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.665164 19807 raft_consensus.cc:504] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.666117 19807 leader_election.cc:288] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 3 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:14.666896 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:14.666949 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:14.667160 19883 raft_consensus.cc:3032] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:17:14.667181 19956 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.667277 19883 raft_consensus.cc:729] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:14.667598 19883 consensus_queue.cc:260] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.668027 19883 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.669780 19956 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 3.
I20240502 14:17:14.670416 19774 leader_election.cc:302] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:14.670430 19883 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 3.
I20240502 14:17:14.670878 20108 raft_consensus.cc:2781] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:17:14.671399 20108 raft_consensus.cc:686] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:14.671826 20108 consensus_queue.cc:237] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.675235 19704 catalog_manager.cc:5484] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 2 to 3, leader changed from e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2) to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 3 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:14.861243 20115 raft_consensus.cc:979] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: : Instructing follower 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.861451 20115 raft_consensus.cc:1067] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Signalling peer 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.862176 19807 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:35586
I20240502 14:17:14.862423 19807 raft_consensus.cc:482] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:14.862557 19807 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.865552 19807 raft_consensus.cc:504] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.866647 19807 leader_election.cc:288] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 3 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:14.867373 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:14.867375 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:14.867758 19956 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.867755 19883 raft_consensus.cc:3032] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:17:14.867936 19883 raft_consensus.cc:729] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:14.868264 19883 consensus_queue.cc:260] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.868678 19883 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.870522 19956 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 3.
I20240502 14:17:14.870858 19883 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 3.
I20240502 14:17:14.871187 19774 leader_election.cc:302] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:14.871546 20108 raft_consensus.cc:2781] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:17:14.871758 20108 raft_consensus.cc:686] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:14.872162 20108 consensus_queue.cc:237] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.873785 20107 raft_consensus.cc:979] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: : Instructing follower 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.874151 20123 raft_consensus.cc:1067] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Signalling peer 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.875460 19807 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:35596
I20240502 14:17:14.875784 19807 raft_consensus.cc:482] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:14.875939 19807 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:14.876488 19704 catalog_manager.cc:5484] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 2 to 3, leader changed from e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2) to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 3 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:14.879328 19807 raft_consensus.cc:504] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.880465 19807 leader_election.cc:288] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 4 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:14.881019 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:14.881115 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f351b236cbf7446480345c0a126aad9d" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:14.881256 19883 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:14.881350 19956 raft_consensus.cc:3032] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:17:14.881492 19956 raft_consensus.cc:729] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:14.881824 19956 consensus_queue.cc:260] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.882241 19956 raft_consensus.cc:3037] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:14.883834 19883 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 4.
I20240502 14:17:14.884373 19772 leader_election.cc:302] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:14.884757 20108 raft_consensus.cc:2781] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:17:14.884892 19956 raft_consensus.cc:2454] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 4.
I20240502 14:17:14.885002 20108 raft_consensus.cc:686] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:14.885334 20108 consensus_queue.cc:237] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.888774 19704 catalog_manager.cc:5484] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 3 to 4, leader changed from f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3) to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 4 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:14.973860 20107 raft_consensus.cc:979] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: : Instructing follower 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.974098 20107 raft_consensus.cc:1067] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Signalling peer 57b01b1ad13f4b39ad2d0220817eaa0d to start an election
I20240502 14:17:14.974933 19807 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
from {username='slave'} at 127.0.0.1:35596
I20240502 14:17:14.975224 19807 raft_consensus.cc:482] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:14.975342 19807 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.977538 19807 raft_consensus.cc:504] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.978302 19807 leader_election.cc:288] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 3 election: Requested vote from peers e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:14.979007 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:14.979014 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "103f07eafa5e448fa7b87a06f341de95" candidate_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:14.979252 19883 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.979288 19956 raft_consensus.cc:3032] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:17:14.979388 19956 raft_consensus.cc:729] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:14.979691 19956 consensus_queue.cc:260] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.980062 19956 raft_consensus.cc:3037] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:14.981640 19883 raft_consensus.cc:2454] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 3.
I20240502 14:17:14.982134 19772 leader_election.cc:302] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068; no voters:
I20240502 14:17:14.982308 19956 raft_consensus.cc:2454] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57b01b1ad13f4b39ad2d0220817eaa0d in term 3.
I20240502 14:17:14.982455 20108 raft_consensus.cc:2781] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:17:14.982688 20108 raft_consensus.cc:686] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Becoming Leader. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:14.983031 20108 consensus_queue.cc:237] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:14.986200 19704 catalog_manager.cc:5484] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d reported cstate change: term changed from 2 to 3, leader changed from f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3) to 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1). New cstate: current_term: 3 leader_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:15.139353 19883 raft_consensus.cc:1261] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:15.140034 20117 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:15.144963 19956 raft_consensus.cc:1261] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:15.145614 20117 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:15.318993 19956 raft_consensus.cc:1261] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:17:15.319706 20117 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:15.324321 19883 raft_consensus.cc:1261] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:17:15.325024 20130 consensus_queue.cc:1035] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:15.442272 19883 raft_consensus.cc:1261] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:15.442988 20130 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:15.446916 19956 raft_consensus.cc:1261] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:15.447643 20108 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:15.512918 19956 raft_consensus.cc:1261] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:15.513649 20130 consensus_queue.cc:1035] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:15.517932 19883 raft_consensus.cc:1261] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Refusing update from remote peer 57b01b1ad13f4b39ad2d0220817eaa0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:15.518774 20108 consensus_queue.cc:1035] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:17.640041 19136 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240502 14:17:17.640470 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:17.643855 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:35604
I20240502 14:17:17.644189 19807 raft_consensus.cc:595] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Received request to transfer leadership to TS f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:17.645462 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:35604
I20240502 14:17:17.645768 19807 raft_consensus.cc:595] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Received request to transfer leadership to TS e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:17.647006 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:35604
I20240502 14:17:17.647231 19807 raft_consensus.cc:595] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Received request to transfer leadership to TS e7ad344eaca649949d0b8ca36f87f068
I20240502 14:17:17.648414 19807 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029"
dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
mode: GRACEFUL
new_leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:35604
I20240502 14:17:17.648732 19807 raft_consensus.cc:595] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Received request to transfer leadership to TS f20ea149e0a049829dc1d8810f7a5e31
I20240502 14:17:17.649271 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240502 14:17:17.649551 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:17.681174 20108 raft_consensus.cc:979] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:17.681422 20108 raft_consensus.cc:1067] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Signalling peer e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:17.682346 19882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:56286
I20240502 14:17:17.682682 19882 raft_consensus.cc:482] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:17.682808 19882 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:17.685751 19882 raft_consensus.cc:504] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.686966 19882 leader_election.cc:288] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 4 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:17.687620 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:17.687835 19807 raft_consensus.cc:3032] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:17:17.687772 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67a0809e54dd4d4d86c3989974bf2519" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:17.687938 19807 raft_consensus.cc:729] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:17.688094 19956 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:17.688270 19807 consensus_queue.cc:260] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.688592 19807 raft_consensus.cc:3037] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:17.694453 19807 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 4.
I20240502 14:17:17.694453 19956 raft_consensus.cc:2454] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 4.
I20240502 14:17:17.695362 19847 leader_election.cc:302] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 57b01b1ad13f4b39ad2d0220817eaa0d, e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:17.695736 20116 raft_consensus.cc:2781] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:17:17.696156 20116 raft_consensus.cc:686] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 4 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:17.696465 20116 consensus_queue.cc:237] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.699451 19704 catalog_manager.cc:5484] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 3 to 4, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 4 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:17.780094 20139 raft_consensus.cc:979] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:17.780341 20139 raft_consensus.cc:1067] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Signalling peer e7ad344eaca649949d0b8ca36f87f068 to start an election
I20240502 14:17:17.781127 19882 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9"
dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
from {username='slave'} at 127.0.0.1:56286
I20240502 14:17:17.781350 19882 raft_consensus.cc:482] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:17.781477 19882 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:17.783708 19882 raft_consensus.cc:504] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.784466 19882 leader_election.cc:288] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 4 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3:35039)
I20240502 14:17:17.785079 19956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
I20240502 14:17:17.785091 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "940723383ee8421fb6cb9a7281fdf8f9" candidate_uuid: "e7ad344eaca649949d0b8ca36f87f068" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:17.785316 19956 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:17.785390 19807 raft_consensus.cc:3032] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Stepping down as leader of term 3
I20240502 14:17:17.785540 19807 raft_consensus.cc:729] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:17.785913 19807 consensus_queue.cc:260] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.786695 19807 raft_consensus.cc:3037] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Advancing to term 4
I20240502 14:17:17.788162 19956 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 4.
I20240502 14:17:17.788569 19849 leader_election.cc:302] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:17.788889 20116 raft_consensus.cc:2781] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 14:17:17.789140 20116 raft_consensus.cc:686] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 4 LEADER]: Becoming Leader. State: Replica: e7ad344eaca649949d0b8ca36f87f068, State: Running, Role: LEADER
I20240502 14:17:17.789265 19807 raft_consensus.cc:2454] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7ad344eaca649949d0b8ca36f87f068 in term 4.
I20240502 14:17:17.789513 20116 consensus_queue.cc:237] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.792729 19704 catalog_manager.cc:5484] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 reported cstate change: term changed from 3 to 4, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2). New cstate: current_term: 4 leader_uuid: "e7ad344eaca649949d0b8ca36f87f068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:17.937315 20139 raft_consensus.cc:979] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:17.937601 20139 raft_consensus.cc:1067] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Signalling peer f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:17.938553 19956 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:55834
I20240502 14:17:17.938818 19956 raft_consensus.cc:482] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:17.938957 19956 raft_consensus.cc:3037] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:17.941051 19956 raft_consensus.cc:504] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.941984 19956 leader_election.cc:288] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 2 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:17.942638 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:17.942660 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e365a5ebb6d840dc8b1e88886fd89029" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:17.942896 19807 raft_consensus.cc:3032] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Stepping down as leader of term 1
I20240502 14:17:17.942915 19882 raft_consensus.cc:3037] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:17.943020 19807 raft_consensus.cc:729] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:17.943331 19807 consensus_queue.cc:260] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.943724 19807 raft_consensus.cc:3037] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Advancing to term 2
I20240502 14:17:17.945550 19882 raft_consensus.cc:2454] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 2.
I20240502 14:17:17.945943 19807 raft_consensus.cc:2454] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 2.
I20240502 14:17:17.946202 19921 leader_election.cc:302] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:17.946520 20107 raft_consensus.cc:2781] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 14:17:17.947033 20107 raft_consensus.cc:686] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:17.947351 20107 consensus_queue.cc:237] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.950487 19704 catalog_manager.cc:5484] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 1 to 2, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 2 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:17.972657 20108 raft_consensus.cc:979] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: : Instructing follower f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:17.972892 20139 raft_consensus.cc:1067] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Signalling peer f20ea149e0a049829dc1d8810f7a5e31 to start an election
I20240502 14:17:17.973966 19956 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989"
dest_uuid: "f20ea149e0a049829dc1d8810f7a5e31"
from {username='slave'} at 127.0.0.1:55834
I20240502 14:17:17.974340 19956 raft_consensus.cc:482] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 14:17:17.974496 19956 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:17.977324 19956 raft_consensus.cc:504] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.978142 19956 leader_election.cc:288] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 3 election: Requested vote from peers 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239), e7ad344eaca649949d0b8ca36f87f068 (127.18.176.2:43175)
I20240502 14:17:17.978803 19882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7ad344eaca649949d0b8ca36f87f068"
I20240502 14:17:17.978929 19807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218fb1b729b74ac2bf6067fed6871989" candidate_uuid: "f20ea149e0a049829dc1d8810f7a5e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d"
I20240502 14:17:17.979038 19882 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:17.979153 19807 raft_consensus.cc:3032] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Stepping down as leader of term 2
I20240502 14:17:17.979269 19807 raft_consensus.cc:729] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57b01b1ad13f4b39ad2d0220817eaa0d, State: Running, Role: LEADER
I20240502 14:17:17.979636 19807 consensus_queue.cc:260] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.980046 19807 raft_consensus.cc:3037] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Advancing to term 3
I20240502 14:17:17.981541 19882 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 3.
I20240502 14:17:17.982057 19921 leader_election.cc:302] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7ad344eaca649949d0b8ca36f87f068, f20ea149e0a049829dc1d8810f7a5e31; no voters:
I20240502 14:17:17.982411 20107 raft_consensus.cc:2781] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 14:17:17.982595 20107 raft_consensus.cc:686] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Becoming Leader. State: Replica: f20ea149e0a049829dc1d8810f7a5e31, State: Running, Role: LEADER
I20240502 14:17:17.982983 20107 consensus_queue.cc:237] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } }
I20240502 14:17:17.983069 19807 raft_consensus.cc:2454] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20ea149e0a049829dc1d8810f7a5e31 in term 3.
I20240502 14:17:17.986071 19704 catalog_manager.cc:5484] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 reported cstate change: term changed from 2 to 3, leader changed from 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1) to f20ea149e0a049829dc1d8810f7a5e31 (127.18.176.3). New cstate: current_term: 3 leader_uuid: "f20ea149e0a049829dc1d8810f7a5e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:18.137799 19807 raft_consensus.cc:1261] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:17:18.138403 20116 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:18.143962 19956 raft_consensus.cc:1261] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:17:18.144872 20116 consensus_queue.cc:1035] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:18.256726 19807 raft_consensus.cc:1261] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:17:18.257820 20116 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:18.263382 19956 raft_consensus.cc:1261] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Refusing update from remote peer e7ad344eaca649949d0b8ca36f87f068: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 14:17:18.264364 20156 consensus_queue.cc:1035] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ea149e0a049829dc1d8810f7a5e31" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:18.457796 19882 raft_consensus.cc:1261] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:18.458513 20107 consensus_queue.cc:1035] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:18.464316 19807 raft_consensus.cc:1261] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 14:17:18.464955 20107 consensus_queue.cc:1035] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:18.484249 19807 raft_consensus.cc:1261] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:18.485010 20107 consensus_queue.cc:1035] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57b01b1ad13f4b39ad2d0220817eaa0d" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:18.489881 19882 raft_consensus.cc:1261] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Refusing update from remote peer f20ea149e0a049829dc1d8810f7a5e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 14:17:18.490640 20107 consensus_queue.cc:1035] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7ad344eaca649949d0b8ca36f87f068" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:18.650007 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:18.651930 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:18.652218 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:19.652751 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:19.654943 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:19.655236 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:20.660985 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:20.663213 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:20.663506 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:21.663866 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:21.665634 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:21.665865 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:22.666389 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:22.668242 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:22.668502 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:23.669086 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:23.670917 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:23.671142 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:24.671659 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:24.673485 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:24.673748 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:25.674268 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:25.676239 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:25.676470 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:26.677014 19136 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 14:17:26.678792 19136 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 14:17:26.679051 19136 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 14:17:27.692680 19136 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240502 14:17:27.692932 19136 tablet_server.cc:178] TabletServer@127.18.176.1:0 shutting down...
I20240502 14:17:27.718205 19136 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 14:17:27.718644 19136 tablet_replica.cc:330] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.718871 19136 raft_consensus.cc:2229] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.719105 19136 raft_consensus.cc:2258] T b56fffeac0494533a94ae337979bd8cb P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.719791 19136 tablet_replica.cc:330] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.719949 19136 raft_consensus.cc:2229] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.720098 19136 raft_consensus.cc:2258] T 1f56ac46a0754affa20b9aa5b917963c P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.720561 19136 tablet_replica.cc:330] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.720700 19136 raft_consensus.cc:2229] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.720830 19136 raft_consensus.cc:2258] T 67a0809e54dd4d4d86c3989974bf2519 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.721279 19136 tablet_replica.cc:330] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.721413 19136 raft_consensus.cc:2229] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.721535 19136 raft_consensus.cc:2258] T e365a5ebb6d840dc8b1e88886fd89029 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.721937 19136 tablet_replica.cc:330] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.722072 19136 raft_consensus.cc:2229] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.722195 19136 raft_consensus.cc:2258] T 940723383ee8421fb6cb9a7281fdf8f9 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.722630 19136 tablet_replica.cc:330] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.722769 19136 raft_consensus.cc:2229] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.723074 19136 raft_consensus.cc:2258] T 103f07eafa5e448fa7b87a06f341de95 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.723547 19136 tablet_replica.cc:330] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.723667 19136 raft_consensus.cc:2229] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.723789 19136 raft_consensus.cc:2258] T 218fb1b729b74ac2bf6067fed6871989 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.724210 19136 tablet_replica.cc:330] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.724346 19136 raft_consensus.cc:2229] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.724648 19136 raft_consensus.cc:2258] T f48acad258464650873b115bf412c2e8 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.725083 19136 tablet_replica.cc:330] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.725201 19136 raft_consensus.cc:2229] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.725450 19136 raft_consensus.cc:2258] T 2888d23ddf87436199097249d3376f51 P 57b01b1ad13f4b39ad2d0220817eaa0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.725903 19136 tablet_replica.cc:330] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d: stopping tablet replica
I20240502 14:17:27.726027 19136 raft_consensus.cc:2229] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.726270 19136 raft_consensus.cc:2258] T f351b236cbf7446480345c0a126aad9d P 57b01b1ad13f4b39ad2d0220817eaa0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.742905 19136 tablet_server.cc:194] TabletServer@127.18.176.1:0 shutdown complete.
I20240502 14:17:27.748010 19136 tablet_server.cc:178] TabletServer@127.18.176.2:0 shutting down...
I20240502 14:17:27.757913 19136 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 14:17:27.758234 19136 tablet_replica.cc:330] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.758460 19136 raft_consensus.cc:2229] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.758765 19136 raft_consensus.cc:2258] T f351b236cbf7446480345c0a126aad9d P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.759464 19136 tablet_replica.cc:330] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.759627 19136 raft_consensus.cc:2229] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 4 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.759948 19136 raft_consensus.cc:2258] T 67a0809e54dd4d4d86c3989974bf2519 P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.760516 19136 tablet_replica.cc:330] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.760668 19136 raft_consensus.cc:2229] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.760809 19136 raft_consensus.cc:2258] T e365a5ebb6d840dc8b1e88886fd89029 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.761283 19136 tablet_replica.cc:330] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.761431 19136 raft_consensus.cc:2229] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.761687 19136 raft_consensus.cc:2258] T f48acad258464650873b115bf412c2e8 P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.762215 19136 tablet_replica.cc:330] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.762387 19136 raft_consensus.cc:2229] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.762552 19136 raft_consensus.cc:2258] T 218fb1b729b74ac2bf6067fed6871989 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.763012 19136 tablet_replica.cc:330] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.763135 19136 raft_consensus.cc:2229] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.763263 19136 raft_consensus.cc:2258] T 103f07eafa5e448fa7b87a06f341de95 P e7ad344eaca649949d0b8ca36f87f068 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.763675 19136 tablet_replica.cc:330] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.763790 19136 raft_consensus.cc:2229] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 4 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.764101 19136 raft_consensus.cc:2258] T 940723383ee8421fb6cb9a7281fdf8f9 P e7ad344eaca649949d0b8ca36f87f068 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.764536 19136 tablet_replica.cc:330] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.764647 19136 raft_consensus.cc:2229] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.764752 19136 raft_consensus.cc:2258] T 2888d23ddf87436199097249d3376f51 P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.765126 19136 tablet_replica.cc:330] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.765224 19136 raft_consensus.cc:2229] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.765343 19136 raft_consensus.cc:2258] T 1f56ac46a0754affa20b9aa5b917963c P e7ad344eaca649949d0b8ca36f87f068 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.765756 19136 tablet_replica.cc:330] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068: stopping tablet replica
I20240502 14:17:27.765854 19136 raft_consensus.cc:2229] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 1 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.766106 19136 raft_consensus.cc:2258] T b56fffeac0494533a94ae337979bd8cb P e7ad344eaca649949d0b8ca36f87f068 [term 1 FOLLOWER]: Raft consensus is shut down!
W20240502 14:17:27.779700 19921 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.176.1:42239: connect: Connection refused (error 111)
W20240502 14:17:27.781450 19921 consensus_peers.cc:485] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 -> Peer 57b01b1ad13f4b39ad2d0220817eaa0d (127.18.176.1:42239): Couldn't send request to peer 57b01b1ad13f4b39ad2d0220817eaa0d. Status: Network error: Client connection negotiation failed: client connection to 127.18.176.1:42239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:27.782629 19136 tablet_server.cc:194] TabletServer@127.18.176.2:0 shutdown complete.
I20240502 14:17:27.787830 19136 tablet_server.cc:178] TabletServer@127.18.176.3:0 shutting down...
I20240502 14:17:27.798100 19136 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 14:17:27.798455 19136 tablet_replica.cc:330] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.798679 19136 raft_consensus.cc:2229] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.798892 19136 raft_consensus.cc:2258] T f48acad258464650873b115bf412c2e8 P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.799526 19136 tablet_replica.cc:330] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.799683 19136 raft_consensus.cc:2229] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.799822 19136 raft_consensus.cc:2258] T f351b236cbf7446480345c0a126aad9d P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.800282 19136 tablet_replica.cc:330] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.800424 19136 raft_consensus.cc:2229] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.800563 19136 raft_consensus.cc:2258] T 67a0809e54dd4d4d86c3989974bf2519 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.800990 19136 tablet_replica.cc:330] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.801132 19136 raft_consensus.cc:2229] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.801417 19136 raft_consensus.cc:2258] T 218fb1b729b74ac2bf6067fed6871989 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.801847 19136 tablet_replica.cc:330] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.801980 19136 raft_consensus.cc:2229] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.802101 19136 raft_consensus.cc:2258] T b56fffeac0494533a94ae337979bd8cb P f20ea149e0a049829dc1d8810f7a5e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.802516 19136 tablet_replica.cc:330] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.802716 19136 raft_consensus.cc:2229] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.802991 19136 raft_consensus.cc:2258] T 1f56ac46a0754affa20b9aa5b917963c P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.809829 19136 tablet_replica.cc:330] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.810025 19136 raft_consensus.cc:2229] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.810186 19136 raft_consensus.cc:2258] T 2888d23ddf87436199097249d3376f51 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.810709 19136 tablet_replica.cc:330] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.810837 19136 raft_consensus.cc:2229] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.810961 19136 raft_consensus.cc:2258] T 940723383ee8421fb6cb9a7281fdf8f9 P f20ea149e0a049829dc1d8810f7a5e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.811368 19136 tablet_replica.cc:330] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.811472 19136 raft_consensus.cc:2229] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:27.811581 19136 raft_consensus.cc:2258] T 103f07eafa5e448fa7b87a06f341de95 P f20ea149e0a049829dc1d8810f7a5e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.811949 19136 tablet_replica.cc:330] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31: stopping tablet replica
I20240502 14:17:27.812050 19136 raft_consensus.cc:2229] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.812326 19136 raft_consensus.cc:2258] T e365a5ebb6d840dc8b1e88886fd89029 P f20ea149e0a049829dc1d8810f7a5e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.828640 19136 tablet_server.cc:194] TabletServer@127.18.176.3:0 shutdown complete.
I20240502 14:17:27.833963 19136 master.cc:537] Master@127.18.176.62:41877 shutting down...
I20240502 14:17:27.843243 19136 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 1 LEADER]: Raft consensus shutting down.
I20240502 14:17:27.843545 19136 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:27.843662 19136 tablet_replica.cc:330] T 00000000000000000000000000000000 P 81d7a1162af44f839bb8236ff0997a1d: stopping tablet replica
I20240502 14:17:27.858240 19136 master.cc:552] Master@127.18.176.62:41877 shutdown complete.
57b01b1ad13f4b39ad2d0220817eaa0d 5
e7ad344eaca649949d0b8ca36f87f068 4
f20ea149e0a049829dc1d8810f7a5e31 1
57b01b1ad13f4b39ad2d0220817eaa0d 4
e7ad344eaca649949d0b8ca36f87f068 3
f20ea149e0a049829dc1d8810f7a5e31 3
57b01b1ad13f4b39ad2d0220817eaa0d 8
e7ad344eaca649949d0b8ca36f87f068 1
f20ea149e0a049829dc1d8810f7a5e31 1
57b01b1ad13f4b39ad2d0220817eaa0d 4
e7ad344eaca649949d0b8ca36f87f068 3
f20ea149e0a049829dc1d8810f7a5e31 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27635 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240502 14:17:27.875303 19136 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.176.62:42365
I20240502 14:17:27.875905 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:27.879534 20170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:27.879534 20171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:27.879799 20173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:27.880491 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:27.880831 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:27.880887 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:27.880923 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659447880919 us; error 0 us; skew 500 ppm
I20240502 14:17:27.881101 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:27.887804 19136 webserver.cc:460] Webserver started at http://127.18.176.62:44649/ using document root <none> and password file <none>
I20240502 14:17:27.888116 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:27.888195 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:27.888339 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:27.889089 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/master-0-root/instance:
uuid: "ad5d846993bb49b79799293d8d9df075"
format_stamp: "Formatted at 2024-05-02 14:17:27 on dist-test-slave-02q2"
I20240502 14:17:27.892256 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 14:17:27.894204 20178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:27.894701 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 14:17:27.894826 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/master-0-root
uuid: "ad5d846993bb49b79799293d8d9df075"
format_stamp: "Formatted at 2024-05-02 14:17:27 on dist-test-slave-02q2"
I20240502 14:17:27.894946 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:27.913554 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:27.914248 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:27.928992 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.62:42365
I20240502 14:17:27.929011 20229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.62:42365 every 8 connection(s)
I20240502 14:17:27.930519 20230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:27.935441 20230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075: Bootstrap starting.
I20240502 14:17:27.936957 20230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:27.939040 20230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075: No bootstrap required, opened a new log
I20240502 14:17:27.939775 20230 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5d846993bb49b79799293d8d9df075" member_type: VOTER }
I20240502 14:17:27.939931 20230 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:27.939980 20230 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5d846993bb49b79799293d8d9df075, State: Initialized, Role: FOLLOWER
I20240502 14:17:27.940207 20230 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5d846993bb49b79799293d8d9df075" member_type: VOTER }
I20240502 14:17:27.940323 20230 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 14:17:27.940357 20230 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 14:17:27.940428 20230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:27.942462 20230 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5d846993bb49b79799293d8d9df075" member_type: VOTER }
I20240502 14:17:27.942735 20230 leader_election.cc:302] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad5d846993bb49b79799293d8d9df075; no voters:
I20240502 14:17:27.943241 20230 leader_election.cc:288] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 14:17:27.943421 20233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:27.943956 20233 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [term 1 LEADER]: Becoming Leader. State: Replica: ad5d846993bb49b79799293d8d9df075, State: Running, Role: LEADER
I20240502 14:17:27.944269 20230 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 14:17:27.944239 20233 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5d846993bb49b79799293d8d9df075" member_type: VOTER }
I20240502 14:17:27.945602 20234 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad5d846993bb49b79799293d8d9df075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5d846993bb49b79799293d8d9df075" member_type: VOTER } }
I20240502 14:17:27.945864 20234 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [sys.catalog]: This master's current role is: LEADER
I20240502 14:17:27.946177 20235 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad5d846993bb49b79799293d8d9df075. Latest consensus state: current_term: 1 leader_uuid: "ad5d846993bb49b79799293d8d9df075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad5d846993bb49b79799293d8d9df075" member_type: VOTER } }
I20240502 14:17:27.946408 20235 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075 [sys.catalog]: This master's current role is: LEADER
I20240502 14:17:27.947393 20240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 14:17:27.948948 20240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 14:17:27.950237 19136 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 14:17:27.952544 20240 catalog_manager.cc:1347] Generated new cluster ID: d8b38937a3fa4d9d9fb82601cf86fd09
I20240502 14:17:27.952658 20240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 14:17:27.962282 20240 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 14:17:27.963366 20240 catalog_manager.cc:1504] Loading token signing keys...
I20240502 14:17:27.973534 20240 catalog_manager.cc:5857] T 00000000000000000000000000000000 P ad5d846993bb49b79799293d8d9df075: Generated new TSK 0
I20240502 14:17:27.973862 20240 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 14:17:27.983924 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:27.987455 20251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:27.987540 20252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:27.988075 20254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:27.988276 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:27.988606 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:27.988672 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:27.988713 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659447988706 us; error 0 us; skew 500 ppm
I20240502 14:17:27.988880 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:27.990470 19136 webserver.cc:460] Webserver started at http://127.18.176.1:34845/ using document root <none> and password file <none>
I20240502 14:17:27.990796 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:27.990867 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:27.991003 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:27.991704 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root/instance:
uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
format_stamp: "Formatted at 2024-05-02 14:17:27 on dist-test-slave-02q2"
I20240502 14:17:27.994701 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20240502 14:17:27.997066 20259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:27.997586 19136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:27.997717 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root
uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
format_stamp: "Formatted at 2024-05-02 14:17:27 on dist-test-slave-02q2"
I20240502 14:17:27.997866 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:28.022843 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:28.023531 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:28.024224 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:28.025255 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:28.025323 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.025409 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:28.025446 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.041087 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.1:46599
I20240502 14:17:28.041101 20321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.1:46599 every 8 connection(s)
I20240502 14:17:28.042932 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:28.046568 20327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:28.046641 20326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:28.052664 20322 heartbeater.cc:347] Connected to a master server at 127.18.176.62:42365
W20240502 14:17:28.052783 20329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:28.052897 20322 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:28.053370 20322 heartbeater.cc:511] Master 127.18.176.62:42365 requested a full tablet report, sending...
I20240502 14:17:28.054713 20195 ts_manager.cc:194] Registered new tserver with Master: 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:28.056180 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:28.056521 20195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45010
I20240502 14:17:28.056682 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:28.056782 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:28.056854 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659448056825 us; error 0 us; skew 500 ppm
I20240502 14:17:28.057265 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:28.059156 19136 webserver.cc:460] Webserver started at http://127.18.176.2:41067/ using document root <none> and password file <none>
I20240502 14:17:28.059412 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:28.059509 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:28.059656 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:28.060343 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root/instance:
uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
format_stamp: "Formatted at 2024-05-02 14:17:28 on dist-test-slave-02q2"
I20240502 14:17:28.063277 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240502 14:17:28.065171 20334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.065685 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 14:17:28.065850 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root
uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
format_stamp: "Formatted at 2024-05-02 14:17:28 on dist-test-slave-02q2"
I20240502 14:17:28.065989 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:28.073504 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:28.074182 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:28.074898 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:28.075896 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:28.075982 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.076102 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:28.076156 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.090960 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.2:35997
I20240502 14:17:28.090998 20396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.2:35997 every 8 connection(s)
I20240502 14:17:28.092841 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:28.096800 20400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:28.096912 20401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:28.098604 20403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:28.098701 19136 server_base.cc:1034] running on GCE node
I20240502 14:17:28.099269 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:28.099395 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:28.099478 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659448099441 us; error 0 us; skew 500 ppm
I20240502 14:17:28.099700 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:28.101680 19136 webserver.cc:460] Webserver started at http://127.18.176.3:34361/ using document root <none> and password file <none>
I20240502 14:17:28.102001 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:28.102145 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:28.102344 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:28.102336 20397 heartbeater.cc:347] Connected to a master server at 127.18.176.62:42365
I20240502 14:17:28.102607 20397 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:28.103083 20397 heartbeater.cc:511] Master 127.18.176.62:42365 requested a full tablet report, sending...
I20240502 14:17:28.103243 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root/instance:
uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
format_stamp: "Formatted at 2024-05-02 14:17:28 on dist-test-slave-02q2"
I20240502 14:17:28.104147 20195 ts_manager.cc:194] Registered new tserver with Master: cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:28.105012 20195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45014
I20240502 14:17:28.106731 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240502 14:17:28.108620 20408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.109030 19136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 14:17:28.109169 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root
uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
format_stamp: "Formatted at 2024-05-02 14:17:28 on dist-test-slave-02q2"
I20240502 14:17:28.109308 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:28.124743 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:28.125432 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:28.126133 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:28.127218 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:28.127297 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.127380 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:28.127437 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:28.142661 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.3:42527
I20240502 14:17:28.142705 20470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.3:42527 every 8 connection(s)
I20240502 14:17:28.150115 20471 heartbeater.cc:347] Connected to a master server at 127.18.176.62:42365
I20240502 14:17:28.150316 20471 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:28.150830 20471 heartbeater.cc:511] Master 127.18.176.62:42365 requested a full tablet report, sending...
I20240502 14:17:28.151845 20195 ts_manager.cc:194] Registered new tserver with Master: 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:28.151916 19136 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008237837s
I20240502 14:17:28.152753 20195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45020
I20240502 14:17:28.153383 19136 test_util.cc:268] Using random seed: 1129407753
I20240502 14:17:28.167591 20195 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45024:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 14:17:28.169188 20195 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 14:17:28.218683 20286 tablet_service.cc:1467] Processing CreateTablet for tablet 280de9137a504b0da16a5b94da293e21 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 14:17:28.219030 20285 tablet_service.cc:1467] Processing CreateTablet for tablet 0474531a543f442394edd73dcab1c44f (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 14:17:28.219592 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280de9137a504b0da16a5b94da293e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.220978 20279 tablet_service.cc:1467] Processing CreateTablet for tablet 1281a87774cd4da88b6b3d87bad1bae0 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 14:17:28.221586 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1281a87774cd4da88b6b3d87bad1bae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.222069 20357 tablet_service.cc:1467] Processing CreateTablet for tablet 36124283cbed413fb7b7e2ca9bf6e9ed (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 14:17:28.222726 20362 tablet_service.cc:1467] Processing CreateTablet for tablet c39456f2fe304a7495aa5a12b287355a (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 14:17:28.222936 20355 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d42d8daf049888a825ccbe6343ee5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 14:17:28.223006 20284 tablet_service.cc:1467] Processing CreateTablet for tablet 5337902e81584821b6043d974664e91e (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 14:17:28.223489 20284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5337902e81584821b6043d974664e91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.223706 20353 tablet_service.cc:1467] Processing CreateTablet for tablet 178abc14522d436bbdf38744d5897c72 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 14:17:28.223739 20361 tablet_service.cc:1467] Processing CreateTablet for tablet 280de9137a504b0da16a5b94da293e21 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 14:17:28.224355 20357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36124283cbed413fb7b7e2ca9bf6e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.224768 20359 tablet_service.cc:1467] Processing CreateTablet for tablet 5337902e81584821b6043d974664e91e (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 14:17:28.225309 20359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5337902e81584821b6043d974664e91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.226989 20281 tablet_service.cc:1467] Processing CreateTablet for tablet 43f64edf80f7483f862c2175acf7fcd0 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 14:17:28.227057 20282 tablet_service.cc:1467] Processing CreateTablet for tablet 36124283cbed413fb7b7e2ca9bf6e9ed (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 14:17:28.227578 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43f64edf80f7483f862c2175acf7fcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.227717 20280 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d42d8daf049888a825ccbe6343ee5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 14:17:28.228415 20278 tablet_service.cc:1467] Processing CreateTablet for tablet 178abc14522d436bbdf38744d5897c72 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 14:17:28.229009 20280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d42d8daf049888a825ccbe6343ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.224364 20360 tablet_service.cc:1467] Processing CreateTablet for tablet 0474531a543f442394edd73dcab1c44f (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 14:17:28.231088 20358 tablet_service.cc:1467] Processing CreateTablet for tablet cc414b64340d4b92a9fd283fcfb142e7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 14:17:28.231308 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0474531a543f442394edd73dcab1c44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.231676 20358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc414b64340d4b92a9fd283fcfb142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.231927 20361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280de9137a504b0da16a5b94da293e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.231096 20283 tablet_service.cc:1467] Processing CreateTablet for tablet cc414b64340d4b92a9fd283fcfb142e7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 14:17:28.232890 20354 tablet_service.cc:1467] Processing CreateTablet for tablet 1281a87774cd4da88b6b3d87bad1bae0 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 14:17:28.218683 20287 tablet_service.cc:1467] Processing CreateTablet for tablet c39456f2fe304a7495aa5a12b287355a (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 14:17:28.234220 20356 tablet_service.cc:1467] Processing CreateTablet for tablet 43f64edf80f7483f862c2175acf7fcd0 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 14:17:28.234920 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c39456f2fe304a7495aa5a12b287355a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.235173 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1281a87774cd4da88b6b3d87bad1bae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.235368 20285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0474531a543f442394edd73dcab1c44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.235415 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 178abc14522d436bbdf38744d5897c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.235692 20282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36124283cbed413fb7b7e2ca9bf6e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.235780 20356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43f64edf80f7483f862c2175acf7fcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.238847 20278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 178abc14522d436bbdf38744d5897c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.242431 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d42d8daf049888a825ccbe6343ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.242599 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc414b64340d4b92a9fd283fcfb142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.258250 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c39456f2fe304a7495aa5a12b287355a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.258800 20286 tablet_service.cc:1467] Processing CreateTablet for tablet 5e07c30ae11a43d687cdf58bfbaa6fbf (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 14:17:28.259364 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e07c30ae11a43d687cdf58bfbaa6fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.266949 20360 tablet_service.cc:1467] Processing CreateTablet for tablet adc2243a26fa4068aa4aa7424062292d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 14:17:28.267653 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2243a26fa4068aa4aa7424062292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.269937 20359 tablet_service.cc:1467] Processing CreateTablet for tablet 5e07c30ae11a43d687cdf58bfbaa6fbf (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 14:17:28.271119 20353 tablet_service.cc:1467] Processing CreateTablet for tablet 14dd72fc610048cfb635bac34dec59a7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 14:17:28.275022 20354 tablet_service.cc:1467] Processing CreateTablet for tablet 0e49d78d2eff446c90190e4818e95b86 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 14:17:28.276718 20359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e07c30ae11a43d687cdf58bfbaa6fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.276885 20282 tablet_service.cc:1467] Processing CreateTablet for tablet adc2243a26fa4068aa4aa7424062292d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 14:17:28.277221 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14dd72fc610048cfb635bac34dec59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.278342 20282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2243a26fa4068aa4aa7424062292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.278570 20362 tablet_service.cc:1467] Processing CreateTablet for tablet a677e91ff17845bda5bce77bf3d5de22 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 14:17:28.279088 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e49d78d2eff446c90190e4818e95b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.279364 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a677e91ff17845bda5bce77bf3d5de22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.283083 20287 tablet_service.cc:1467] Processing CreateTablet for tablet a677e91ff17845bda5bce77bf3d5de22 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 14:17:28.283730 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a677e91ff17845bda5bce77bf3d5de22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.287206 20279 tablet_service.cc:1467] Processing CreateTablet for tablet 14dd72fc610048cfb635bac34dec59a7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 14:17:28.287995 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14dd72fc610048cfb635bac34dec59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.291235 20435 tablet_service.cc:1467] Processing CreateTablet for tablet 280de9137a504b0da16a5b94da293e21 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 14:17:28.291942 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280de9137a504b0da16a5b94da293e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.292021 20283 tablet_service.cc:1467] Processing CreateTablet for tablet 0e49d78d2eff446c90190e4818e95b86 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 14:17:28.292518 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e49d78d2eff446c90190e4818e95b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.294258 20487 tablet_bootstrap.cc:492] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:28.294734 20436 tablet_service.cc:1467] Processing CreateTablet for tablet c39456f2fe304a7495aa5a12b287355a (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 14:17:28.295174 20433 tablet_service.cc:1467] Processing CreateTablet for tablet 5337902e81584821b6043d974664e91e (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 14:17:28.295329 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c39456f2fe304a7495aa5a12b287355a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.295662 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5337902e81584821b6043d974664e91e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.296195 20434 tablet_service.cc:1467] Processing CreateTablet for tablet 0474531a543f442394edd73dcab1c44f (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 14:17:28.296622 20487 tablet_bootstrap.cc:654] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.296687 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0474531a543f442394edd73dcab1c44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.297008 20355 tablet_service.cc:1467] Processing CreateTablet for tablet 14720d4da7a449b3be42bbf006da1545 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 14:17:28.297466 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14720d4da7a449b3be42bbf006da1545. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.299027 20432 tablet_service.cc:1467] Processing CreateTablet for tablet cc414b64340d4b92a9fd283fcfb142e7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 14:17:28.299564 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc414b64340d4b92a9fd283fcfb142e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.300858 20284 tablet_service.cc:1467] Processing CreateTablet for tablet 14720d4da7a449b3be42bbf006da1545 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 14:17:28.301350 20284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14720d4da7a449b3be42bbf006da1545. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.301409 20278 tablet_service.cc:1467] Processing CreateTablet for tablet 20ca5560d70b4ebaa937b4cb2fc4dffe (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 14:17:28.301826 20278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ca5560d70b4ebaa937b4cb2fc4dffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.303043 20431 tablet_service.cc:1467] Processing CreateTablet for tablet 36124283cbed413fb7b7e2ca9bf6e9ed (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 14:17:28.303514 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36124283cbed413fb7b7e2ca9bf6e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.306008 20361 tablet_service.cc:1467] Processing CreateTablet for tablet 20ca5560d70b4ebaa937b4cb2fc4dffe (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 14:17:28.310740 20430 tablet_service.cc:1467] Processing CreateTablet for tablet 43f64edf80f7483f862c2175acf7fcd0 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 14:17:28.314397 20361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ca5560d70b4ebaa937b4cb2fc4dffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.315223 20286 tablet_service.cc:1467] Processing CreateTablet for tablet 27d675ca2ff64753ae52ae207d7d9dc9 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 14:17:28.315959 20280 tablet_service.cc:1467] Processing CreateTablet for tablet d13319c6da9c4e6db72f64f500fc28d5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 14:17:28.317812 20428 tablet_service.cc:1467] Processing CreateTablet for tablet 1281a87774cd4da88b6b3d87bad1bae0 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 14:17:28.319317 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43f64edf80f7483f862c2175acf7fcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.321311 20427 tablet_service.cc:1467] Processing CreateTablet for tablet 178abc14522d436bbdf38744d5897c72 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 14:17:28.322310 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27d675ca2ff64753ae52ae207d7d9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.327555 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 178abc14522d436bbdf38744d5897c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.328016 20433 tablet_service.cc:1467] Processing CreateTablet for tablet 5e07c30ae11a43d687cdf58bfbaa6fbf (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 14:17:28.323514 20429 tablet_service.cc:1467] Processing CreateTablet for tablet ca2d42d8daf049888a825ccbe6343ee5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 14:17:28.331221 20280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d13319c6da9c4e6db72f64f500fc28d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.333609 20357 tablet_service.cc:1467] Processing CreateTablet for tablet 27d675ca2ff64753ae52ae207d7d9dc9 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 14:17:28.334175 20357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27d675ca2ff64753ae52ae207d7d9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.339074 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e07c30ae11a43d687cdf58bfbaa6fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.340839 20487 tablet_bootstrap.cc:492] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:28.344818 20285 tablet_service.cc:1467] Processing CreateTablet for tablet f6df1c0367904b059bb0c07e74314c74 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 14:17:28.346307 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1281a87774cd4da88b6b3d87bad1bae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.347688 20487 ts_tablet_manager.cc:1367] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.004s
I20240502 14:17:28.348297 20486 tablet_bootstrap.cc:492] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:28.347173 20435 tablet_service.cc:1467] Processing CreateTablet for tablet adc2243a26fa4068aa4aa7424062292d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 14:17:28.348752 20279 tablet_service.cc:1467] Processing CreateTablet for tablet f30d3cdb558c479c8431e4a72f073355 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 14:17:28.352655 20285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6df1c0367904b059bb0c07e74314c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.353384 20429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca2d42d8daf049888a825ccbe6343ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.354740 20358 tablet_service.cc:1467] Processing CreateTablet for tablet d13319c6da9c4e6db72f64f500fc28d5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 14:17:28.355343 20358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d13319c6da9c4e6db72f64f500fc28d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.357466 20356 tablet_service.cc:1467] Processing CreateTablet for tablet f30d3cdb558c479c8431e4a72f073355 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 14:17:28.357679 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f30d3cdb558c479c8431e4a72f073355. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.358808 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2243a26fa4068aa4aa7424062292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.360299 20487 raft_consensus.cc:348] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.362156 20356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f30d3cdb558c479c8431e4a72f073355. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.365039 20487 raft_consensus.cc:374] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:28.367211 20281 tablet_service.cc:1467] Processing CreateTablet for tablet 6cce88b36f4e47fdb1f4588104c2917e (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 14:17:28.367802 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cce88b36f4e47fdb1f4588104c2917e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.371351 20487 raft_consensus.cc:729] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:28.372581 20489 tablet_bootstrap.cc:492] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:28.374787 20487 consensus_queue.cc:260] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.378587 20287 tablet_service.cc:1467] Processing CreateTablet for tablet 258d15b6ad4e4416b745eeed7cb3c757 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 14:17:28.382848 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 258d15b6ad4e4416b745eeed7cb3c757. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.388939 20486 tablet_bootstrap.cc:654] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.397290 20431 tablet_service.cc:1467] Processing CreateTablet for tablet 14dd72fc610048cfb635bac34dec59a7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 14:17:28.402915 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14dd72fc610048cfb635bac34dec59a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.418431 20434 tablet_service.cc:1467] Processing CreateTablet for tablet a677e91ff17845bda5bce77bf3d5de22 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 14:17:28.423791 20355 tablet_service.cc:1467] Processing CreateTablet for tablet f6df1c0367904b059bb0c07e74314c74 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 14:17:28.425163 20487 ts_tablet_manager.cc:1398] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.071s user 0.012s sys 0.018s
I20240502 14:17:28.426815 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a677e91ff17845bda5bce77bf3d5de22. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.428444 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6df1c0367904b059bb0c07e74314c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.428512 20322 heartbeater.cc:503] Master 127.18.176.62:42365 was elected leader, sending a full tablet report...
I20240502 14:17:28.428368 20432 tablet_service.cc:1467] Processing CreateTablet for tablet 0e49d78d2eff446c90190e4818e95b86 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 14:17:28.429656 20487 tablet_bootstrap.cc:492] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:28.429859 20283 tablet_service.cc:1467] Processing CreateTablet for tablet c80067ebc4504518a6429c342c100642 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 14:17:28.431591 20284 tablet_service.cc:1467] Processing CreateTablet for tablet 449e6e4e1a274922aa9bf52b2ce7d025 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 14:17:28.435577 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e49d78d2eff446c90190e4818e95b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.438500 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80067ebc4504518a6429c342c100642. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.444111 20284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449e6e4e1a274922aa9bf52b2ce7d025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.454581 20353 tablet_service.cc:1467] Processing CreateTablet for tablet 6cce88b36f4e47fdb1f4588104c2917e (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 14:17:28.485035 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cce88b36f4e47fdb1f4588104c2917e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.488793 20361 tablet_service.cc:1467] Processing CreateTablet for tablet 258d15b6ad4e4416b745eeed7cb3c757 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 14:17:28.489611 20279 tablet_service.cc:1467] Processing CreateTablet for tablet 34fd8e3c3abe4260bfeccff24fbfb20d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 14:17:28.489549 20354 tablet_service.cc:1467] Processing CreateTablet for tablet c80067ebc4504518a6429c342c100642 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 14:17:28.489944 20286 tablet_service.cc:1467] Processing CreateTablet for tablet 984c1d6e64e84bcdb9f5644b8d8a3565 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 14:17:28.490659 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34fd8e3c3abe4260bfeccff24fbfb20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.492400 20361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 258d15b6ad4e4416b745eeed7cb3c757. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.492827 20430 tablet_service.cc:1467] Processing CreateTablet for tablet 14720d4da7a449b3be42bbf006da1545 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 14:17:28.494242 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 984c1d6e64e84bcdb9f5644b8d8a3565. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.497088 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80067ebc4504518a6429c342c100642. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.499526 20357 tablet_service.cc:1467] Processing CreateTablet for tablet 34fd8e3c3abe4260bfeccff24fbfb20d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 14:17:28.502835 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14720d4da7a449b3be42bbf006da1545. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.503523 20280 tablet_service.cc:1467] Processing CreateTablet for tablet daf758a9a8314106bcb1ed7abb8cc220 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 14:17:28.506578 20280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf758a9a8314106bcb1ed7abb8cc220. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.506955 20435 tablet_service.cc:1467] Processing CreateTablet for tablet 20ca5560d70b4ebaa937b4cb2fc4dffe (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 14:17:28.507429 20357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34fd8e3c3abe4260bfeccff24fbfb20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.508667 20489 tablet_bootstrap.cc:654] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.512876 20431 tablet_service.cc:1467] Processing CreateTablet for tablet 27d675ca2ff64753ae52ae207d7d9dc9 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 14:17:28.513612 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20ca5560d70b4ebaa937b4cb2fc4dffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.514155 20287 tablet_service.cc:1467] Processing CreateTablet for tablet f956dfc843814ccd92546e00110c79ca (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 14:17:28.515740 20284 tablet_service.cc:1467] Processing CreateTablet for tablet 39035e415e624aefadb9022d67a91419 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 14:17:28.517199 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27d675ca2ff64753ae52ae207d7d9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.520298 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f956dfc843814ccd92546e00110c79ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.524425 20284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39035e415e624aefadb9022d67a91419. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.525815 20358 tablet_service.cc:1467] Processing CreateTablet for tablet 984c1d6e64e84bcdb9f5644b8d8a3565 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 14:17:28.526465 20282 tablet_service.cc:1467] Processing CreateTablet for tablet a259e566bef947cba083ea525231254d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 14:17:28.526831 20283 tablet_service.cc:1467] Processing CreateTablet for tablet e0daf493925c48a68592d5ac37c56146 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 14:17:28.526929 20360 tablet_service.cc:1467] Processing CreateTablet for tablet 39035e415e624aefadb9022d67a91419 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 14:17:28.527511 20282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a259e566bef947cba083ea525231254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.527473 20359 tablet_service.cc:1467] Processing CreateTablet for tablet 449e6e4e1a274922aa9bf52b2ce7d025 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 14:17:28.527442 20358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 984c1d6e64e84bcdb9f5644b8d8a3565. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.528039 20359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449e6e4e1a274922aa9bf52b2ce7d025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.528507 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39035e415e624aefadb9022d67a91419. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.528756 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0daf493925c48a68592d5ac37c56146. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.532531 20355 tablet_service.cc:1467] Processing CreateTablet for tablet f956dfc843814ccd92546e00110c79ca (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 14:17:28.542277 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f956dfc843814ccd92546e00110c79ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.543452 20427 tablet_service.cc:1467] Processing CreateTablet for tablet d13319c6da9c4e6db72f64f500fc28d5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 14:17:28.544775 20278 tablet_service.cc:1467] Processing CreateTablet for tablet 14a741834267475b957eb3203e8e0563 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 14:17:28.547441 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d13319c6da9c4e6db72f64f500fc28d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.548494 20433 tablet_service.cc:1467] Processing CreateTablet for tablet f30d3cdb558c479c8431e4a72f073355 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 14:17:28.549044 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f30d3cdb558c479c8431e4a72f073355. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.548588 20436 tablet_service.cc:1467] Processing CreateTablet for tablet f6df1c0367904b059bb0c07e74314c74 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 14:17:28.549338 20278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a741834267475b957eb3203e8e0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.550360 20486 tablet_bootstrap.cc:492] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:28.551533 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6df1c0367904b059bb0c07e74314c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.551488 20428 tablet_service.cc:1467] Processing CreateTablet for tablet 6cce88b36f4e47fdb1f4588104c2917e (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 14:17:28.552026 20486 ts_tablet_manager.cc:1367] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.202s user 0.017s sys 0.029s
I20240502 14:17:28.552798 20362 tablet_service.cc:1467] Processing CreateTablet for tablet daf758a9a8314106bcb1ed7abb8cc220 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 14:17:28.553509 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf758a9a8314106bcb1ed7abb8cc220. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.552800 20356 tablet_service.cc:1467] Processing CreateTablet for tablet 14a741834267475b957eb3203e8e0563 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 14:17:28.556489 20353 tablet_service.cc:1467] Processing CreateTablet for tablet a259e566bef947cba083ea525231254d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 14:17:28.557147 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cce88b36f4e47fdb1f4588104c2917e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.558591 20356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a741834267475b957eb3203e8e0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.560124 20281 tablet_service.cc:1467] Processing CreateTablet for tablet e4ebb8c62fbd49dea69b8f289df1bf60 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 14:17:28.562126 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a259e566bef947cba083ea525231254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.563809 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ebb8c62fbd49dea69b8f289df1bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.565073 20432 tablet_service.cc:1467] Processing CreateTablet for tablet 258d15b6ad4e4416b745eeed7cb3c757 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 14:17:28.565176 20354 tablet_service.cc:1467] Processing CreateTablet for tablet e0daf493925c48a68592d5ac37c56146 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 14:17:28.565683 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0daf493925c48a68592d5ac37c56146. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.565713 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 258d15b6ad4e4416b745eeed7cb3c757. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.568934 20280 tablet_service.cc:1467] Processing CreateTablet for tablet 0783d83eb7d948a18a5adffb5d6711ea (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 14:17:28.571836 20285 tablet_service.cc:1467] Processing CreateTablet for tablet f095c3f4591249c0a657287a10657560 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 14:17:28.573247 20280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0783d83eb7d948a18a5adffb5d6711ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20240502 14:17:28.573382 20323 tablet.cc:2369] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 14:17:28.574038 20487 tablet_bootstrap.cc:654] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.573522 20286 tablet_service.cc:1467] Processing CreateTablet for tablet 05eba15f48eb4ff4b1b87d7f36b186a5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 14:17:28.576159 20486 raft_consensus.cc:348] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.577350 20486 raft_consensus.cc:374] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:28.577428 20486 raft_consensus.cc:729] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:28.577913 20486 consensus_queue.cc:260] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.582193 20285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f095c3f4591249c0a657287a10657560. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.586236 20429 tablet_service.cc:1467] Processing CreateTablet for tablet c80067ebc4504518a6429c342c100642 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 14:17:28.587246 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05eba15f48eb4ff4b1b87d7f36b186a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.588914 20429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80067ebc4504518a6429c342c100642. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.595693 20489 tablet_bootstrap.cc:492] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:28.595961 20489 ts_tablet_manager.cc:1367] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.224s user 0.010s sys 0.025s
I20240502 14:17:28.597832 20430 tablet_service.cc:1467] Processing CreateTablet for tablet 449e6e4e1a274922aa9bf52b2ce7d025 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 14:17:28.598320 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449e6e4e1a274922aa9bf52b2ce7d025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.606158 20490 raft_consensus.cc:482] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:28.614248 20489 raft_consensus.cc:348] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.614810 20489 raft_consensus.cc:374] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:28.614892 20489 raft_consensus.cc:729] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:28.619400 20434 tablet_service.cc:1467] Processing CreateTablet for tablet 34fd8e3c3abe4260bfeccff24fbfb20d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 14:17:28.619976 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34fd8e3c3abe4260bfeccff24fbfb20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.606364 20490 raft_consensus.cc:504] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.621073 20486 ts_tablet_manager.cc:1398] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.069s user 0.020s sys 0.006s
I20240502 14:17:28.621462 20486 tablet_bootstrap.cc:492] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:28.622743 20397 heartbeater.cc:503] Master 127.18.176.62:42365 was elected leader, sending a full tablet report...
I20240502 14:17:28.615165 20489 consensus_queue.cc:260] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.636106 20490 leader_election.cc:288] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:28.636968 20279 tablet_service.cc:1467] Processing CreateTablet for tablet ae70452bab2a4001b7e8b60170cbe230 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 14:17:28.642794 20487 tablet_bootstrap.cc:492] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:28.643141 20487 ts_tablet_manager.cc:1367] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.218s user 0.007s sys 0.007s
I20240502 14:17:28.646214 20361 tablet_service.cc:1467] Processing CreateTablet for tablet 0783d83eb7d948a18a5adffb5d6711ea (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 14:17:28.647397 20361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0783d83eb7d948a18a5adffb5d6711ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.649175 20427 tablet_service.cc:1467] Processing CreateTablet for tablet 39035e415e624aefadb9022d67a91419 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 14:17:28.649727 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39035e415e624aefadb9022d67a91419. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.647388 20486 tablet_bootstrap.cc:654] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.646214 20431 tablet_service.cc:1467] Processing CreateTablet for tablet 984c1d6e64e84bcdb9f5644b8d8a3565 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 14:17:28.651960 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae70452bab2a4001b7e8b60170cbe230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.653160 20359 tablet_service.cc:1467] Processing CreateTablet for tablet e4ebb8c62fbd49dea69b8f289df1bf60 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 14:17:28.655984 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 984c1d6e64e84bcdb9f5644b8d8a3565. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.657618 20359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ebb8c62fbd49dea69b8f289df1bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.660607 20283 tablet_service.cc:1467] Processing CreateTablet for tablet 501adddb143b4c03bdf4b0e6476baeac (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 14:17:28.664940 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 501adddb143b4c03bdf4b0e6476baeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.672215 20287 tablet_service.cc:1467] Processing CreateTablet for tablet f88bd39a1f614d9987a0f306980b19d7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 14:17:28.681377 20435 tablet_service.cc:1467] Processing CreateTablet for tablet daf758a9a8314106bcb1ed7abb8cc220 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 14:17:28.683785 20436 tablet_service.cc:1467] Processing CreateTablet for tablet a259e566bef947cba083ea525231254d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 14:17:28.684407 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a259e566bef947cba083ea525231254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.684741 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88bd39a1f614d9987a0f306980b19d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.684782 20284 tablet_service.cc:1467] Processing CreateTablet for tablet 2b09e67785d84964a32c0c7f61d05516 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 14:17:28.685344 20284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b09e67785d84964a32c0c7f61d05516. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.692885 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf758a9a8314106bcb1ed7abb8cc220. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.693841 20432 tablet_service.cc:1467] Processing CreateTablet for tablet f956dfc843814ccd92546e00110c79ca (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 14:17:28.694697 20428 tablet_service.cc:1467] Processing CreateTablet for tablet e0daf493925c48a68592d5ac37c56146 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 14:17:28.695312 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0daf493925c48a68592d5ac37c56146. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.691447 20487 raft_consensus.cc:348] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.698779 20487 raft_consensus.cc:374] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:28.698908 20487 raft_consensus.cc:729] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:28.698668 20355 tablet_service.cc:1467] Processing CreateTablet for tablet f095c3f4591249c0a657287a10657560 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 14:17:28.699250 20487 consensus_queue.cc:260] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.699673 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f095c3f4591249c0a657287a10657560. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.699950 20487 ts_tablet_manager.cc:1398] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
I20240502 14:17:28.700373 20487 tablet_bootstrap.cc:492] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:28.702421 20278 tablet_service.cc:1467] Processing CreateTablet for tablet 079e05082c0c4434a4dcabafa01bfba9 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 14:17:28.703094 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f956dfc843814ccd92546e00110c79ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.710041 20278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 079e05082c0c4434a4dcabafa01bfba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.718847 20434 tablet_service.cc:1467] Processing CreateTablet for tablet 14a741834267475b957eb3203e8e0563 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 14:17:28.719491 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a741834267475b957eb3203e8e0563. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.730105 20357 tablet_service.cc:1467] Processing CreateTablet for tablet ae70452bab2a4001b7e8b60170cbe230 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 14:17:28.731143 20360 tablet_service.cc:1467] Processing CreateTablet for tablet 05eba15f48eb4ff4b1b87d7f36b186a5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 14:17:28.731727 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05eba15f48eb4ff4b1b87d7f36b186a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.733135 20430 tablet_service.cc:1467] Processing CreateTablet for tablet e4ebb8c62fbd49dea69b8f289df1bf60 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 14:17:28.735448 20282 tablet_service.cc:1467] Processing CreateTablet for tablet e989cc9924b04f018e332d78582556f1 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 14:17:28.737416 20354 tablet_service.cc:1467] Processing CreateTablet for tablet 501adddb143b4c03bdf4b0e6476baeac (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 14:17:28.738116 20427 tablet_service.cc:1467] Processing CreateTablet for tablet 0783d83eb7d948a18a5adffb5d6711ea (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 14:17:28.738642 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0783d83eb7d948a18a5adffb5d6711ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.739331 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ebb8c62fbd49dea69b8f289df1bf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.740330 20357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae70452bab2a4001b7e8b60170cbe230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.740955 20361 tablet_service.cc:1467] Processing CreateTablet for tablet f88bd39a1f614d9987a0f306980b19d7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 14:17:28.741495 20286 tablet_service.cc:1467] Processing CreateTablet for tablet fb046706fc504c47870d1f084489befe (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 14:17:28.741928 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb046706fc504c47870d1f084489befe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.742970 20282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e989cc9924b04f018e332d78582556f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.744465 20361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88bd39a1f614d9987a0f306980b19d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.744336 20279 tablet_service.cc:1467] Processing CreateTablet for tablet 17ad302fb34c4af592576654060e05c8 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 14:17:28.747629 20358 tablet_service.cc:1467] Processing CreateTablet for tablet 2b09e67785d84964a32c0c7f61d05516 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 14:17:28.748558 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 501adddb143b4c03bdf4b0e6476baeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.749626 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17ad302fb34c4af592576654060e05c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.753053 20353 tablet_service.cc:1467] Processing CreateTablet for tablet fb046706fc504c47870d1f084489befe (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 14:17:28.753695 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb046706fc504c47870d1f084489befe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.759230 20358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b09e67785d84964a32c0c7f61d05516. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.760053 20362 tablet_service.cc:1467] Processing CreateTablet for tablet 079e05082c0c4434a4dcabafa01bfba9 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 14:17:28.760545 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 079e05082c0c4434a4dcabafa01bfba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.760740 20427 tablet_service.cc:1467] Processing CreateTablet for tablet f095c3f4591249c0a657287a10657560 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 14:17:28.760850 20278 tablet_service.cc:1467] Processing CreateTablet for tablet 25d9972f6b3e44328639f1d4636b5f15 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 14:17:28.761152 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f095c3f4591249c0a657287a10657560. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.761162 20278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d9972f6b3e44328639f1d4636b5f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.762159 20356 tablet_service.cc:1467] Processing CreateTablet for tablet e989cc9924b04f018e332d78582556f1 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 14:17:28.763751 20280 tablet_service.cc:1467] Processing CreateTablet for tablet b64648e3355c4ee789a240f6c34928bc (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 14:17:28.764223 20280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b64648e3355c4ee789a240f6c34928bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.766167 20433 tablet_service.cc:1467] Processing CreateTablet for tablet 05eba15f48eb4ff4b1b87d7f36b186a5 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 14:17:28.766803 20356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e989cc9924b04f018e332d78582556f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.768484 20489 ts_tablet_manager.cc:1398] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.172s user 0.039s sys 0.037s
I20240502 14:17:28.772042 20489 tablet_bootstrap.cc:492] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:28.772234 20435 tablet_service.cc:1467] Processing CreateTablet for tablet ae70452bab2a4001b7e8b60170cbe230 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 14:17:28.772661 20471 heartbeater.cc:503] Master 127.18.176.62:42365 was elected leader, sending a full tablet report...
I20240502 14:17:28.774420 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05eba15f48eb4ff4b1b87d7f36b186a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.779419 20487 tablet_bootstrap.cc:654] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.782152 20285 tablet_service.cc:1467] Processing CreateTablet for tablet 877ddfafada342978bfce99e7190f253 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 14:17:28.784291 20429 tablet_service.cc:1467] Processing CreateTablet for tablet 501adddb143b4c03bdf4b0e6476baeac (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 14:17:28.784729 20429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 501adddb143b4c03bdf4b0e6476baeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.785630 20281 tablet_service.cc:1467] Processing CreateTablet for tablet 8a113e02ef5042539d2d575735a7ba9f (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 14:17:28.786195 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a113e02ef5042539d2d575735a7ba9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.788137 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae70452bab2a4001b7e8b60170cbe230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.789247 20285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877ddfafada342978bfce99e7190f253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.806272 20287 tablet_service.cc:1467] Processing CreateTablet for tablet 232519ff0f174c94893738b64a940863 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 14:17:28.809046 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 232519ff0f174c94893738b64a940863. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.811187 20359 tablet_service.cc:1467] Processing CreateTablet for tablet 25d9972f6b3e44328639f1d4636b5f15 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 14:17:28.821705 20359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d9972f6b3e44328639f1d4636b5f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.821547 20432 tablet_service.cc:1467] Processing CreateTablet for tablet f88bd39a1f614d9987a0f306980b19d7 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 14:17:28.822201 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88bd39a1f614d9987a0f306980b19d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.828752 20486 tablet_bootstrap.cc:492] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:28.828950 20486 ts_tablet_manager.cc:1367] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.208s user 0.015s sys 0.009s
I20240502 14:17:28.832636 20496 raft_consensus.cc:482] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:28.835319 20428 tablet_service.cc:1467] Processing CreateTablet for tablet 2b09e67785d84964a32c0c7f61d05516 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 14:17:28.835748 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b09e67785d84964a32c0c7f61d05516. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.836041 20494 raft_consensus.cc:482] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:28.836123 20489 tablet_bootstrap.cc:654] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.848399 20486 raft_consensus.cc:348] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.850960 20486 raft_consensus.cc:374] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:28.851053 20486 raft_consensus.cc:729] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:28.852267 20486 consensus_queue.cc:260] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.836186 20494 raft_consensus.cc:504] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.855307 20487 tablet_bootstrap.cc:492] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:28.855572 20487 ts_tablet_manager.cc:1367] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.155s user 0.010s sys 0.009s
I20240502 14:17:28.856159 20436 tablet_service.cc:1467] Processing CreateTablet for tablet 079e05082c0c4434a4dcabafa01bfba9 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 14:17:28.857134 20494 leader_election.cc:288] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:28.857291 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 079e05082c0c4434a4dcabafa01bfba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.832845 20496 raft_consensus.cc:504] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.871735 20284 tablet_service.cc:1467] Processing CreateTablet for tablet c607e42684e648b094b78dba336e623d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 14:17:28.875767 20284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c607e42684e648b094b78dba336e623d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.881268 20496 leader_election.cc:288] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:28.889273 20487 raft_consensus.cc:348] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.889585 20487 raft_consensus.cc:374] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:28.889667 20487 raft_consensus.cc:729] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:28.891455 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d42d8daf049888a825ccbe6343ee5" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:28.892128 20283 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6d7c5a9de147b5b055198c5e6ec28a (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 14:17:28.892892 20283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6d7c5a9de147b5b055198c5e6ec28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.896103 20487 consensus_queue.cc:260] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.897043 20487 ts_tablet_manager.cc:1398] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20240502 14:17:28.897807 20487 tablet_bootstrap.cc:492] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:28.907549 20362 tablet_service.cc:1467] Processing CreateTablet for tablet 17ad302fb34c4af592576654060e05c8 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 14:17:28.910414 20433 tablet_service.cc:1467] Processing CreateTablet for tablet e989cc9924b04f018e332d78582556f1 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 14:17:28.914100 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e989cc9924b04f018e332d78582556f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.914100 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17ad302fb34c4af592576654060e05c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.912326 20287 tablet_service.cc:1467] Processing CreateTablet for tablet 45c28c2c6be74c10a33f46e52affd378 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20240502 14:17:28.913030 20261 leader_election.cc:341] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:28.921609 20434 tablet_service.cc:1467] Processing CreateTablet for tablet fb046706fc504c47870d1f084489befe (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 14:17:28.922160 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb046706fc504c47870d1f084489befe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.923476 20486 ts_tablet_manager.cc:1398] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.094s user 0.025s sys 0.021s
I20240502 14:17:28.923840 20486 tablet_bootstrap.cc:492] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:28.929780 20287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45c28c2c6be74c10a33f46e52affd378. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.931320 20357 tablet_service.cc:1467] Processing CreateTablet for tablet 877ddfafada342978bfce99e7190f253 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 14:17:28.931905 20357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877ddfafada342978bfce99e7190f253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.933590 20353 tablet_service.cc:1467] Processing CreateTablet for tablet b64648e3355c4ee789a240f6c34928bc (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 14:17:28.934190 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b64648e3355c4ee789a240f6c34928bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.937834 20279 tablet_service.cc:1467] Processing CreateTablet for tablet b9bf018a7d1845ae9ebcfe4287e2d968 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 14:17:28.938392 20279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9bf018a7d1845ae9ebcfe4287e2d968. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.950241 20286 tablet_service.cc:1467] Processing CreateTablet for tablet c068958fef984876b58d2686669c82d8 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 14:17:28.950976 20286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c068958fef984876b58d2686669c82d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.959077 20487 tablet_bootstrap.cc:654] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:28.968861 20362 tablet_service.cc:1467] Processing CreateTablet for tablet 8a113e02ef5042539d2d575735a7ba9f (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 14:17:28.975939 20354 tablet_service.cc:1467] Processing CreateTablet for tablet 232519ff0f174c94893738b64a940863 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 14:17:28.985677 20354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 232519ff0f174c94893738b64a940863. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.981105 20431 tablet_service.cc:1467] Processing CreateTablet for tablet 25d9972f6b3e44328639f1d4636b5f15 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 14:17:28.983014 20278 tablet_service.cc:1467] Processing CreateTablet for tablet e43e1388daf349469f3c7ae8a0eb3d7c (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 14:17:28.986269 20278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e43e1388daf349469f3c7ae8a0eb3d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.986305 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d9972f6b3e44328639f1d4636b5f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.987586 20362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a113e02ef5042539d2d575735a7ba9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:28.992769 20490 raft_consensus.cc:482] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:28.993002 20490 raft_consensus.cc:504] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:28.996872 20490 leader_election.cc:288] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:28.999389 20361 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6d7c5a9de147b5b055198c5e6ec28a (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 14:17:29.000121 20361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6d7c5a9de147b5b055198c5e6ec28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.002647 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280de9137a504b0da16a5b94da293e21" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.003067 20486 tablet_bootstrap.cc:654] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
W20240502 14:17:29.003413 20261 leader_election.cc:341] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.005059 20435 tablet_service.cc:1467] Processing CreateTablet for tablet 17ad302fb34c4af592576654060e05c8 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 14:17:29.005450 20429 tablet_service.cc:1467] Processing CreateTablet for tablet b64648e3355c4ee789a240f6c34928bc (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 14:17:29.005872 20500 raft_consensus.cc:482] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.006019 20500 raft_consensus.cc:504] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.005592 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17ad302fb34c4af592576654060e05c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.008420 20355 tablet_service.cc:1467] Processing CreateTablet for tablet b9bf018a7d1845ae9ebcfe4287e2d968 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 14:17:29.010928 20429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b64648e3355c4ee789a240f6c34928bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.013125 20358 tablet_service.cc:1467] Processing CreateTablet for tablet 45c28c2c6be74c10a33f46e52affd378 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 14:17:29.013810 20358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45c28c2c6be74c10a33f46e52affd378. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.014377 20356 tablet_service.cc:1467] Processing CreateTablet for tablet c068958fef984876b58d2686669c82d8 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 14:17:29.014952 20356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c068958fef984876b58d2686669c82d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.017980 20489 tablet_bootstrap.cc:492] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.018172 20489 ts_tablet_manager.cc:1367] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.246s user 0.005s sys 0.009s
I20240502 14:17:29.018740 20360 tablet_service.cc:1467] Processing CreateTablet for tablet e43e1388daf349469f3c7ae8a0eb3d7c (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 14:17:29.019196 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e43e1388daf349469f3c7ae8a0eb3d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.020298 20355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9bf018a7d1845ae9ebcfe4287e2d968. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.020668 20357 tablet_service.cc:1467] Processing CreateTablet for tablet c607e42684e648b094b78dba336e623d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 14:17:29.021246 20357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c607e42684e648b094b78dba336e623d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.022342 20500 leader_election.cc:288] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
W20240502 14:17:29.022867 20243 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:17:29.023329 20282 tablet_service.cc:1467] Processing CreateTablet for tablet 83adcbc5033e4631babb7517f375a1bc (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 14:17:29.023414 20281 tablet_service.cc:1467] Processing CreateTablet for tablet 17922984561e4a82922c5080dd75e8c3 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 14:17:29.023876 20282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83adcbc5033e4631babb7517f375a1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.026773 20353 tablet_service.cc:1467] Processing CreateTablet for tablet 17922984561e4a82922c5080dd75e8c3 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 14:17:29.027842 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17922984561e4a82922c5080dd75e8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.028167 20280 tablet_service.cc:1467] Processing CreateTablet for tablet 71b128b85dee4063a827684124960317 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 14:17:29.028702 20280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b128b85dee4063a827684124960317. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.030436 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17922984561e4a82922c5080dd75e8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.034466 20427 tablet_service.cc:1467] Processing CreateTablet for tablet 877ddfafada342978bfce99e7190f253 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 14:17:29.035146 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877ddfafada342978bfce99e7190f253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.047538 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280de9137a504b0da16a5b94da293e21" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:29.048050 20410 leader_election.cc:341] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.049216 20489 raft_consensus.cc:348] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.049516 20489 raft_consensus.cc:374] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.049592 20489 raft_consensus.cc:729] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.054167 20489 consensus_queue.cc:260] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.056325 20430 tablet_service.cc:1467] Processing CreateTablet for tablet 8a113e02ef5042539d2d575735a7ba9f (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 14:17:29.046797 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280de9137a504b0da16a5b94da293e21" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.057045 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a113e02ef5042539d2d575735a7ba9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.057147 20445 raft_consensus.cc:2454] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.061709 20261 leader_election.cc:302] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.065356 20490 raft_consensus.cc:2781] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.065495 20490 raft_consensus.cc:482] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.065562 20490 raft_consensus.cc:3037] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.047191 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d42d8daf049888a825ccbe6343ee5" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:29.070206 20261 leader_election.cc:341] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.070389 20261 leader_election.cc:302] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.070410 20432 tablet_service.cc:1467] Processing CreateTablet for tablet 232519ff0f174c94893738b64a940863 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 14:17:29.071015 20432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 232519ff0f174c94893738b64a940863. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.074741 20428 tablet_service.cc:1467] Processing CreateTablet for tablet c607e42684e648b094b78dba336e623d (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 14:17:29.075361 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c607e42684e648b094b78dba336e623d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.081954 20489 ts_tablet_manager.cc:1398] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.064s user 0.003s sys 0.000s
I20240502 14:17:29.082340 20489 tablet_bootstrap.cc:492] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.100282 20359 tablet_service.cc:1467] Processing CreateTablet for tablet 83adcbc5033e4631babb7517f375a1bc (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 14:17:29.100998 20359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83adcbc5033e4631babb7517f375a1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.108960 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5337902e81584821b6043d974664e91e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.119586 20489 tablet_bootstrap.cc:654] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.120285 20510 raft_consensus.cc:2726] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.109160 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36124283cbed413fb7b7e2ca9bf6e9ed" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.126096 20487 tablet_bootstrap.cc:492] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.126120 20297 raft_consensus.cc:2454] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.126204 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36124283cbed413fb7b7e2ca9bf6e9ed" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.126375 20487 ts_tablet_manager.cc:1367] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.229s user 0.026s sys 0.023s
I20240502 14:17:29.126104 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5337902e81584821b6043d974664e91e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.126515 20445 raft_consensus.cc:2454] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
W20240502 14:17:29.127099 20336 leader_election.cc:341] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.127331 20336 leader_election.cc:302] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.127620 20500 raft_consensus.cc:2781] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.127709 20500 raft_consensus.cc:482] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.127779 20500 raft_consensus.cc:3037] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.133177 20336 leader_election.cc:302] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:29.133512 20494 raft_consensus.cc:2781] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.133621 20494 raft_consensus.cc:482] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.133687 20494 raft_consensus.cc:3037] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
W20240502 14:17:29.133733 20336 leader_election.cc:341] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.125802 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280de9137a504b0da16a5b94da293e21" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.136271 20436 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6d7c5a9de147b5b055198c5e6ec28a (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 14:17:29.137614 20436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6d7c5a9de147b5b055198c5e6ec28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.140722 20486 tablet_bootstrap.cc:492] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.140934 20486 ts_tablet_manager.cc:1367] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.217s user 0.012s sys 0.023s
I20240502 14:17:29.148113 20356 tablet_service.cc:1467] Processing CreateTablet for tablet 71b128b85dee4063a827684124960317 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 14:17:29.148758 20356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b128b85dee4063a827684124960317. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.148947 20433 tablet_service.cc:1467] Processing CreateTablet for tablet 45c28c2c6be74c10a33f46e52affd378 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 14:17:29.149372 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45c28c2c6be74c10a33f46e52affd378. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.150869 20487 raft_consensus.cc:348] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.151077 20487 raft_consensus.cc:374] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.151140 20487 raft_consensus.cc:729] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.151379 20487 consensus_queue.cc:260] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.155539 20487 ts_tablet_manager.cc:1398] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20240502 14:17:29.155921 20487 tablet_bootstrap.cc:492] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.156553 20434 tablet_service.cc:1467] Processing CreateTablet for tablet b9bf018a7d1845ae9ebcfe4287e2d968 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 14:17:29.157631 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9bf018a7d1845ae9ebcfe4287e2d968. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.159720 20486 raft_consensus.cc:348] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.159981 20486 raft_consensus.cc:374] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.160050 20486 raft_consensus.cc:729] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.160295 20486 consensus_queue.cc:260] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.165207 20435 tablet_service.cc:1467] Processing CreateTablet for tablet c068958fef984876b58d2686669c82d8 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 14:17:29.166056 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c068958fef984876b58d2686669c82d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.174640 20494 raft_consensus.cc:504] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.177357 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36124283cbed413fb7b7e2ca9bf6e9ed" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.177362 20430 tablet_service.cc:1467] Processing CreateTablet for tablet e43e1388daf349469f3c7ae8a0eb3d7c (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 14:17:29.177691 20296 raft_consensus.cc:3037] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.177439 20490 raft_consensus.cc:504] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.178053 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e43e1388daf349469f3c7ae8a0eb3d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.177804 20494 leader_election.cc:288] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.179908 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280de9137a504b0da16a5b94da293e21" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.180297 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36124283cbed413fb7b7e2ca9bf6e9ed" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.180740 20295 raft_consensus.cc:2379] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
W20240502 14:17:29.180774 20261 leader_election.cc:341] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:29.181829 20336 leader_election.cc:341] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.182341 20486 ts_tablet_manager.cc:1398] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.041s user 0.009s sys 0.009s
I20240502 14:17:29.182595 20410 leader_election.cc:302] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.182801 20486 tablet_bootstrap.cc:492] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.183009 20496 raft_consensus.cc:3037] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.186858 20487 tablet_bootstrap.cc:654] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.188489 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280de9137a504b0da16a5b94da293e21" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.188812 20490 leader_election.cc:288] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.192739 20296 raft_consensus.cc:2454] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.193307 20336 leader_election.cc:302] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:29.193917 20512 raft_consensus.cc:2781] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.195317 20500 raft_consensus.cc:504] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.198608 20500 leader_election.cc:288] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.199132 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5337902e81584821b6043d974664e91e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
W20240502 14:17:29.202311 20336 leader_election.cc:341] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.203336 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5337902e81584821b6043d974664e91e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.203635 20446 raft_consensus.cc:3037] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.207185 20486 tablet_bootstrap.cc:654] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.208860 20431 tablet_service.cc:1467] Processing CreateTablet for tablet 17922984561e4a82922c5080dd75e8c3 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 14:17:29.211750 20512 raft_consensus.cc:686] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:29.214995 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17922984561e4a82922c5080dd75e8c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.222030 20512 consensus_queue.cc:237] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.240680 20446 raft_consensus.cc:2454] T 5337902e81584821b6043d974664e91e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.241289 20336 leader_election.cc:302] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac
I20240502 14:17:29.241582 20428 tablet_service.cc:1467] Processing CreateTablet for tablet 83adcbc5033e4631babb7517f375a1bc (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 14:17:29.241847 20500 raft_consensus.cc:2781] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.242017 20500 raft_consensus.cc:686] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:29.242158 20428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83adcbc5033e4631babb7517f375a1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.242512 20500 consensus_queue.cc:237] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.249589 20496 raft_consensus.cc:2726] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.250216 20489 tablet_bootstrap.cc:492] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.250387 20489 ts_tablet_manager.cc:1367] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.168s user 0.009s sys 0.008s
I20240502 14:17:29.252316 20433 tablet_service.cc:1467] Processing CreateTablet for tablet 71b128b85dee4063a827684124960317 (DEFAULT_TABLE table=test-workload [id=cb60678755a14f70a88f1910a3b63182]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 14:17:29.257171 20433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b128b85dee4063a827684124960317. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:29.258579 20489 raft_consensus.cc:348] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.258878 20489 raft_consensus.cc:374] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.258934 20489 raft_consensus.cc:729] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.253974 20192 catalog_manager.cc:5484] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.259212 20489 consensus_queue.cc:260] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.260003 20489 ts_tablet_manager.cc:1398] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20240502 14:17:29.260386 20489 tablet_bootstrap.cc:492] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.272213 20487 tablet_bootstrap.cc:492] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.272444 20487 ts_tablet_manager.cc:1367] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.001s
I20240502 14:17:29.275133 20487 raft_consensus.cc:348] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.275483 20487 raft_consensus.cc:374] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.275542 20487 raft_consensus.cc:729] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.275810 20487 consensus_queue.cc:260] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.281229 20487 ts_tablet_manager.cc:1398] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s
I20240502 14:17:29.281877 20487 tablet_bootstrap.cc:492] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.284644 20445 raft_consensus.cc:2454] T 280de9137a504b0da16a5b94da293e21 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.287185 20261 leader_election.cc:302] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.287746 20490 raft_consensus.cc:2781] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.287899 20490 raft_consensus.cc:686] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:29.288192 20490 consensus_queue.cc:237] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.297660 20512 raft_consensus.cc:482] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.297870 20512 raft_consensus.cc:504] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.298806 20512 leader_election.cc:288] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.300401 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0474531a543f442394edd73dcab1c44f" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.300951 20487 tablet_bootstrap.cc:654] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
W20240502 14:17:29.301373 20336 leader_election.cc:341] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.301740 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0474531a543f442394edd73dcab1c44f" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:29.302263 20336 leader_election.cc:341] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.302775 20336 leader_election.cc:302] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:29.303079 20512 raft_consensus.cc:2726] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.305212 20486 tablet_bootstrap.cc:492] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.305375 20486 ts_tablet_manager.cc:1367] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.123s user 0.016s sys 0.012s
I20240502 14:17:29.306926 20489 tablet_bootstrap.cc:654] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.308713 20194 catalog_manager.cc:5484] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.310633 20486 raft_consensus.cc:348] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.310946 20486 raft_consensus.cc:374] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.311053 20486 raft_consensus.cc:729] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.311304 20486 consensus_queue.cc:260] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.312770 20489 tablet_bootstrap.cc:492] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.312860 20486 ts_tablet_manager.cc:1398] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20240502 14:17:29.312944 20489 ts_tablet_manager.cc:1367] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
I20240502 14:17:29.313239 20486 tablet_bootstrap.cc:492] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.313822 20489 raft_consensus.cc:348] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.314049 20489 raft_consensus.cc:374] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.314103 20489 raft_consensus.cc:729] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.314376 20489 consensus_queue.cc:260] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.315205 20489 ts_tablet_manager.cc:1398] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240502 14:17:29.315569 20486 tablet_bootstrap.cc:654] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.315693 20489 tablet_bootstrap.cc:492] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.318142 20489 tablet_bootstrap.cc:654] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.322124 20487 tablet_bootstrap.cc:492] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.322330 20487 ts_tablet_manager.cc:1367] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.004s
I20240502 14:17:29.322990 20486 tablet_bootstrap.cc:492] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.323149 20486 ts_tablet_manager.cc:1367] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20240502 14:17:29.323383 20487 raft_consensus.cc:348] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.323621 20487 raft_consensus.cc:374] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.323714 20487 raft_consensus.cc:729] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.324026 20486 raft_consensus.cc:348] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.324065 20487 consensus_queue.cc:260] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.324224 20486 raft_consensus.cc:374] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.324275 20486 raft_consensus.cc:729] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.324703 20487 ts_tablet_manager.cc:1398] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240502 14:17:29.325021 20487 tablet_bootstrap.cc:492] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.324476 20486 consensus_queue.cc:260] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.325930 20486 ts_tablet_manager.cc:1398] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.326279 20486 tablet_bootstrap.cc:492] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.327036 20487 tablet_bootstrap.cc:654] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.327476 20489 tablet_bootstrap.cc:492] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.327692 20489 ts_tablet_manager.cc:1367] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20240502 14:17:29.328135 20486 tablet_bootstrap.cc:654] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.328822 20489 raft_consensus.cc:348] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.329123 20489 raft_consensus.cc:374] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.329192 20489 raft_consensus.cc:729] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.329576 20489 consensus_queue.cc:260] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.330461 20489 ts_tablet_manager.cc:1398] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20240502 14:17:29.330919 20489 tablet_bootstrap.cc:492] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.333529 20489 tablet_bootstrap.cc:654] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.333920 20486 tablet_bootstrap.cc:492] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.334280 20486 ts_tablet_manager.cc:1367] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20240502 14:17:29.335341 20486 raft_consensus.cc:348] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.335655 20486 raft_consensus.cc:374] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.335726 20486 raft_consensus.cc:729] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.336087 20486 consensus_queue.cc:260] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.336814 20486 ts_tablet_manager.cc:1398] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:29.337163 20486 tablet_bootstrap.cc:492] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.341701 20486 tablet_bootstrap.cc:654] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.342434 20489 tablet_bootstrap.cc:492] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.342710 20489 ts_tablet_manager.cc:1367] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.002s
I20240502 14:17:29.343709 20487 tablet_bootstrap.cc:492] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.343910 20487 ts_tablet_manager.cc:1367] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.012s
I20240502 14:17:29.343958 20489 raft_consensus.cc:348] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.344290 20489 raft_consensus.cc:374] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.344400 20489 raft_consensus.cc:729] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.344652 20487 raft_consensus.cc:348] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.344863 20487 raft_consensus.cc:374] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.344935 20487 raft_consensus.cc:729] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.344734 20489 consensus_queue.cc:260] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.345155 20487 consensus_queue.cc:260] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.345585 20489 ts_tablet_manager.cc:1398] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.345960 20487 ts_tablet_manager.cc:1398] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:29.346068 20489 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.346413 20487 tablet_bootstrap.cc:492] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.349314 20489 tablet_bootstrap.cc:654] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.350111 20487 tablet_bootstrap.cc:654] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.351049 20486 tablet_bootstrap.cc:492] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.351224 20486 ts_tablet_manager.cc:1367] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s
I20240502 14:17:29.351672 20193 catalog_manager.cc:5484] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.352140 20486 raft_consensus.cc:348] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.352349 20486 raft_consensus.cc:374] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.352402 20486 raft_consensus.cc:729] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.352735 20486 consensus_queue.cc:260] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.353533 20486 ts_tablet_manager.cc:1398] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.353978 20486 tablet_bootstrap.cc:492] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.356060 20489 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.356269 20489 ts_tablet_manager.cc:1367] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240502 14:17:29.357270 20489 raft_consensus.cc:348] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.358161 20489 raft_consensus.cc:374] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.361032 20489 raft_consensus.cc:729] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.361349 20489 consensus_queue.cc:260] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.361917 20489 ts_tablet_manager.cc:1398] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20240502 14:17:29.362287 20489 tablet_bootstrap.cc:492] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.360388 20486 tablet_bootstrap.cc:654] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.364663 20489 tablet_bootstrap.cc:654] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.366369 20487 tablet_bootstrap.cc:492] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.366611 20487 ts_tablet_manager.cc:1367] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.007s
I20240502 14:17:29.367617 20487 raft_consensus.cc:348] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.367905 20487 raft_consensus.cc:374] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.367967 20487 raft_consensus.cc:729] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.368315 20487 consensus_queue.cc:260] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.369958 20487 ts_tablet_manager.cc:1398] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.370352 20487 tablet_bootstrap.cc:492] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.371829 20486 tablet_bootstrap.cc:492] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.372016 20486 ts_tablet_manager.cc:1367] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20240502 14:17:29.372769 20486 raft_consensus.cc:348] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.372982 20486 raft_consensus.cc:374] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.373042 20486 raft_consensus.cc:729] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.373345 20486 consensus_queue.cc:260] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.373850 20487 tablet_bootstrap.cc:654] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.376760 20486 ts_tablet_manager.cc:1398] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20240502 14:17:29.377226 20486 tablet_bootstrap.cc:492] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.377429 20487 tablet_bootstrap.cc:492] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.377600 20487 ts_tablet_manager.cc:1367] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240502 14:17:29.378947 20487 raft_consensus.cc:348] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.379238 20487 raft_consensus.cc:374] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.379299 20487 raft_consensus.cc:729] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.379478 20486 tablet_bootstrap.cc:654] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.379633 20487 consensus_queue.cc:260] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.380959 20487 ts_tablet_manager.cc:1398] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:29.381374 20487 tablet_bootstrap.cc:492] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.384434 20487 tablet_bootstrap.cc:654] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.388200 20486 tablet_bootstrap.cc:492] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.388413 20489 tablet_bootstrap.cc:492] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.388453 20486 ts_tablet_manager.cc:1367] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.010s
I20240502 14:17:29.388579 20489 ts_tablet_manager.cc:1367] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.007s
I20240502 14:17:29.389389 20489 raft_consensus.cc:348] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.389583 20489 raft_consensus.cc:374] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.389617 20489 raft_consensus.cc:729] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.389837 20487 tablet_bootstrap.cc:492] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.390019 20487 ts_tablet_manager.cc:1367] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20240502 14:17:29.389853 20489 consensus_queue.cc:260] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.390489 20489 ts_tablet_manager.cc:1398] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:29.390847 20489 tablet_bootstrap.cc:492] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.390887 20486 raft_consensus.cc:348] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.391052 20486 raft_consensus.cc:374] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.391098 20486 raft_consensus.cc:729] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.391009 20487 raft_consensus.cc:348] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.391218 20487 raft_consensus.cc:374] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.391310 20487 raft_consensus.cc:729] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.391350 20486 consensus_queue.cc:260] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.391569 20487 consensus_queue.cc:260] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.392189 20487 ts_tablet_manager.cc:1398] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:29.392599 20487 tablet_bootstrap.cc:492] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.392812 20489 tablet_bootstrap.cc:654] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.394464 20486 ts_tablet_manager.cc:1398] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20240502 14:17:29.394696 20487 tablet_bootstrap.cc:654] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.394971 20486 tablet_bootstrap.cc:492] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.397084 20486 tablet_bootstrap.cc:654] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.404560 20487 tablet_bootstrap.cc:492] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.404850 20487 ts_tablet_manager.cc:1367] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20240502 14:17:29.405969 20487 raft_consensus.cc:348] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.406286 20487 raft_consensus.cc:374] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.406360 20487 raft_consensus.cc:729] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.406661 20487 consensus_queue.cc:260] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.407320 20487 ts_tablet_manager.cc:1398] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:17:29.407703 20487 tablet_bootstrap.cc:492] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.408630 20489 tablet_bootstrap.cc:492] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.408854 20489 ts_tablet_manager.cc:1367] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.009s
I20240502 14:17:29.409483 20487 tablet_bootstrap.cc:654] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.409973 20489 raft_consensus.cc:348] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.410249 20489 raft_consensus.cc:374] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.410321 20489 raft_consensus.cc:729] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.410679 20489 consensus_queue.cc:260] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.411356 20489 ts_tablet_manager.cc:1398] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 14:17:29.411710 20489 tablet_bootstrap.cc:492] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.412389 20487 tablet_bootstrap.cc:492] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.412550 20487 ts_tablet_manager.cc:1367] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240502 14:17:29.413177 20496 raft_consensus.cc:482] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.413333 20496 raft_consensus.cc:504] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.413470 20487 raft_consensus.cc:348] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.413722 20489 tablet_bootstrap.cc:654] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.413748 20487 raft_consensus.cc:374] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.413821 20487 raft_consensus.cc:729] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.414100 20487 consensus_queue.cc:260] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.414206 20496 leader_election.cc:288] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.415279 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43f64edf80f7483f862c2175acf7fcd0" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.415486 20296 raft_consensus.cc:2454] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.415489 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43f64edf80f7483f862c2175acf7fcd0" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.416452 20486 tablet_bootstrap.cc:492] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.416636 20486 ts_tablet_manager.cc:1367] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.009s
I20240502 14:17:29.416695 20410 leader_election.cc:302] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
W20240502 14:17:29.417075 20410 leader_election.cc:341] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.417330 20487 ts_tablet_manager.cc:1398] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240502 14:17:29.417505 20486 raft_consensus.cc:348] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.417733 20486 raft_consensus.cc:374] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.417799 20486 raft_consensus.cc:729] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.417924 20487 tablet_bootstrap.cc:492] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.418006 20486 consensus_queue.cc:260] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.418118 20496 raft_consensus.cc:2781] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.418224 20496 raft_consensus.cc:482] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.418301 20496 raft_consensus.cc:3037] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.418517 20486 ts_tablet_manager.cc:1398] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:29.418888 20486 tablet_bootstrap.cc:492] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.419910 20487 tablet_bootstrap.cc:654] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.420818 20486 tablet_bootstrap.cc:654] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.425320 20512 raft_consensus.cc:482] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.425606 20512 raft_consensus.cc:504] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.426789 20512 leader_election.cc:288] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.428400 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc414b64340d4b92a9fd283fcfb142e7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.428485 20496 raft_consensus.cc:504] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.428776 20296 raft_consensus.cc:2454] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.429419 20496 leader_election.cc:288] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.429654 20496 raft_consensus.cc:482] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.429786 20496 raft_consensus.cc:504] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.431594 20336 leader_election.cc:302] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.432152 20512 raft_consensus.cc:2781] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.432260 20512 raft_consensus.cc:482] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.432333 20512 raft_consensus.cc:3037] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.434422 20496 leader_election.cc:288] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.437137 20512 raft_consensus.cc:504] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.438591 20487 tablet_bootstrap.cc:492] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.441079 20487 ts_tablet_manager.cc:1367] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.001s
I20240502 14:17:29.441253 20486 tablet_bootstrap.cc:492] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.441435 20486 ts_tablet_manager.cc:1367] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.011s
I20240502 14:17:29.442122 20487 raft_consensus.cc:348] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.442368 20487 raft_consensus.cc:374] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.442453 20487 raft_consensus.cc:729] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.442595 20486 raft_consensus.cc:348] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.442759 20486 raft_consensus.cc:374] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.442812 20486 raft_consensus.cc:729] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.442729 20487 consensus_queue.cc:260] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.442967 20486 consensus_queue.cc:260] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.443368 20487 ts_tablet_manager.cc:1398] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.443586 20486 ts_tablet_manager.cc:1398] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.442267 20512 leader_election.cc:288] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.443919 20486 tablet_bootstrap.cc:492] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.445180 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc414b64340d4b92a9fd283fcfb142e7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.445504 20296 raft_consensus.cc:3037] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.446851 20486 tablet_bootstrap.cc:654] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.443743 20487 tablet_bootstrap.cc:492] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.451704 20487 tablet_bootstrap.cc:654] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.452639 20296 raft_consensus.cc:2454] T cc414b64340d4b92a9fd283fcfb142e7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.453392 20336 leader_election.cc:302] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.458109 20512 raft_consensus.cc:2781] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.459926 20512 raft_consensus.cc:686] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:29.460423 20512 consensus_queue.cc:237] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.462450 20487 tablet_bootstrap.cc:492] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.462744 20487 ts_tablet_manager.cc:1367] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.007s
I20240502 14:17:29.463780 20487 raft_consensus.cc:348] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.464160 20487 raft_consensus.cc:374] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.464285 20487 raft_consensus.cc:729] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.464643 20487 consensus_queue.cc:260] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.465381 20487 ts_tablet_manager.cc:1398] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:29.469259 20487 tablet_bootstrap.cc:492] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.471958 20487 tablet_bootstrap.cc:654] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.464956 20194 catalog_manager.cc:5484] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.476889 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc414b64340d4b92a9fd283fcfb142e7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.477185 20489 tablet_bootstrap.cc:492] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.477249 20445 raft_consensus.cc:2454] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.477355 20489 ts_tablet_manager.cc:1367] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.066s user 0.021s sys 0.039s
I20240502 14:17:29.477684 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc414b64340d4b92a9fd283fcfb142e7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.477751 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178abc14522d436bbdf38744d5897c72" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.477834 20445 raft_consensus.cc:3037] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.477628 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178abc14522d436bbdf38744d5897c72" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.477948 20295 raft_consensus.cc:2454] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.478060 20371 raft_consensus.cc:2454] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.478315 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43f64edf80f7483f862c2175acf7fcd0" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.478508 20372 raft_consensus.cc:3037] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.478874 20410 leader_election.cc:302] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.479265 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43f64edf80f7483f862c2175acf7fcd0" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.479440 20546 raft_consensus.cc:2781] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.480134 20489 raft_consensus.cc:348] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.480681 20546 raft_consensus.cc:482] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.482376 20489 raft_consensus.cc:374] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.482982 20489 raft_consensus.cc:729] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.484282 20489 consensus_queue.cc:260] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.485111 20489 ts_tablet_manager.cc:1398] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20240502 14:17:29.486119 20296 raft_consensus.cc:3037] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.486702 20546 raft_consensus.cc:3037] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.487429 20445 raft_consensus.cc:2454] T cc414b64340d4b92a9fd283fcfb142e7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.487879 20489 tablet_bootstrap.cc:492] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.490371 20489 tablet_bootstrap.cc:654] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.486032 20372 raft_consensus.cc:2454] T 43f64edf80f7483f862c2175acf7fcd0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.491776 20410 leader_election.cc:302] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.492347 20496 raft_consensus.cc:2781] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.501200 20490 raft_consensus.cc:482] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.501521 20490 raft_consensus.cc:504] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.503213 20490 leader_election.cc:288] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.503443 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.503538 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:29.504148 20261 leader_election.cc:341] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:29.504657 20261 leader_election.cc:341] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.504806 20261 leader_election.cc:302] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.505184 20490 raft_consensus.cc:2726] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.506647 20546 raft_consensus.cc:504] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.509198 20296 raft_consensus.cc:2454] T 43f64edf80f7483f862c2175acf7fcd0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.510696 20496 raft_consensus.cc:686] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:29.513728 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178abc14522d436bbdf38744d5897c72" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.514099 20552 raft_consensus.cc:482] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.514349 20372 raft_consensus.cc:3037] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.515540 20486 tablet_bootstrap.cc:492] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.515648 20489 tablet_bootstrap.cc:492] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.514093 20546 leader_election.cc:288] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.515859 20489 ts_tablet_manager.cc:1367] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20240502 14:17:29.515868 20486 ts_tablet_manager.cc:1367] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.072s user 0.025s sys 0.043s
I20240502 14:17:29.515933 20487 tablet_bootstrap.cc:492] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.516113 20487 ts_tablet_manager.cc:1367] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.047s user 0.018s sys 0.018s
I20240502 14:17:29.516992 20486 raft_consensus.cc:348] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.517027 20489 raft_consensus.cc:348] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.517007 20487 raft_consensus.cc:348] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.517300 20489 raft_consensus.cc:374] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.517586 20487 raft_consensus.cc:374] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.517585 20489 raft_consensus.cc:729] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.517693 20487 raft_consensus.cc:729] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.517793 20372 raft_consensus.cc:2454] T 178abc14522d436bbdf38744d5897c72 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.517946 20489 consensus_queue.cc:260] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.517975 20487 consensus_queue.cc:260] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.518661 20489 ts_tablet_manager.cc:1398] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20240502 14:17:29.518719 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "178abc14522d436bbdf38744d5897c72" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.519026 20489 tablet_bootstrap.cc:492] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.514357 20552 raft_consensus.cc:504] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.520232 20552 leader_election.cc:288] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.522358 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14dd72fc610048cfb635bac34dec59a7" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.522358 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14dd72fc610048cfb635bac34dec59a7" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.522655 20295 raft_consensus.cc:2454] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.522714 20410 leader_election.cc:302] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.521631 20489 tablet_bootstrap.cc:654] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.521755 20296 raft_consensus.cc:3037] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.523073 20552 raft_consensus.cc:2781] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.523221 20552 raft_consensus.cc:686] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:29.523499 20552 consensus_queue.cc:237] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.520563 20487 ts_tablet_manager.cc:1398] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 14:17:29.524988 20410 leader_election.cc:302] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:29.525343 20490 raft_consensus.cc:482] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.525521 20490 raft_consensus.cc:504] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.525369 20546 raft_consensus.cc:2781] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.525928 20487 tablet_bootstrap.cc:492] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.526012 20546 raft_consensus.cc:482] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.526161 20546 raft_consensus.cc:3037] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.526232 20490 leader_election.cc:288] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.527168 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a677e91ff17845bda5bce77bf3d5de22" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:29.527827 20261 leader_election.cc:341] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.527967 20487 tablet_bootstrap.cc:654] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.528147 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a677e91ff17845bda5bce77bf3d5de22" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:29.528720 20261 leader_election.cc:341] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.528824 20261 leader_election.cc:302] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.529254 20490 raft_consensus.cc:2726] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.532971 20296 raft_consensus.cc:2454] T 178abc14522d436bbdf38744d5897c72 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.535873 20546 raft_consensus.cc:504] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.533586 20487 tablet_bootstrap.cc:492] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.514183 20496 consensus_queue.cc:237] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.536711 20487 ts_tablet_manager.cc:1367] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20240502 14:17:29.537564 20487 raft_consensus.cc:348] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.537777 20487 raft_consensus.cc:374] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.537832 20487 raft_consensus.cc:729] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.538044 20487 consensus_queue.cc:260] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.538684 20487 ts_tablet_manager.cc:1398] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.539049 20487 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.541285 20487 tablet_bootstrap.cc:654] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.542119 20489 tablet_bootstrap.cc:492] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.542284 20489 ts_tablet_manager.cc:1367] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.005s
I20240502 14:17:29.542922 20486 raft_consensus.cc:374] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.543032 20486 raft_consensus.cc:729] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.543244 20489 raft_consensus.cc:348] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.543310 20486 consensus_queue.cc:260] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.543462 20489 raft_consensus.cc:374] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.543534 20489 raft_consensus.cc:729] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.543547 20372 raft_consensus.cc:2454] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.543764 20489 consensus_queue.cc:260] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.544392 20486 ts_tablet_manager.cc:1398] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.028s user 0.023s sys 0.000s
I20240502 14:17:29.544775 20486 tablet_bootstrap.cc:492] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.546414 20486 tablet_bootstrap.cc:654] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.546633 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14dd72fc610048cfb635bac34dec59a7" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.546891 20296 raft_consensus.cc:3037] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.549743 20487 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.549903 20487 ts_tablet_manager.cc:1367] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20240502 14:17:29.550053 20296 raft_consensus.cc:2454] T 14dd72fc610048cfb635bac34dec59a7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.550127 20489 ts_tablet_manager.cc:1398] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20240502 14:17:29.550504 20489 tablet_bootstrap.cc:492] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.550833 20410 leader_election.cc:302] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:29.550745 20487 raft_consensus.cc:348] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.551067 20487 raft_consensus.cc:374] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.551134 20487 raft_consensus.cc:729] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.551353 20552 raft_consensus.cc:2781] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.551484 20552 raft_consensus.cc:686] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:29.551746 20552 consensus_queue.cc:237] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.552129 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14dd72fc610048cfb635bac34dec59a7" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.552301 20372 raft_consensus.cc:3037] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.552592 20489 tablet_bootstrap.cc:654] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.555732 20372 raft_consensus.cc:2454] T 14dd72fc610048cfb635bac34dec59a7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.556174 20487 consensus_queue.cc:260] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.556713 20546 leader_election.cc:288] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.557608 20486 tablet_bootstrap.cc:492] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.557891 20486 ts_tablet_manager.cc:1367] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.007s
I20240502 14:17:29.558851 20486 raft_consensus.cc:348] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.559151 20487 ts_tablet_manager.cc:1398] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20240502 14:17:29.559170 20486 raft_consensus.cc:374] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.559392 20486 raft_consensus.cc:729] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.559571 20487 tablet_bootstrap.cc:492] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.560860 20489 tablet_bootstrap.cc:492] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.561022 20489 ts_tablet_manager.cc:1367] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20240502 14:17:29.559688 20486 consensus_queue.cc:260] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.562661 20486 ts_tablet_manager.cc:1398] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 14:17:29.563019 20486 tablet_bootstrap.cc:492] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.562168 20487 tablet_bootstrap.cc:654] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.564687 20486 tablet_bootstrap.cc:654] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.564410 20194 catalog_manager.cc:5484] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:29.561780 20489 raft_consensus.cc:348] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.565083 20489 raft_consensus.cc:374] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.565164 20489 raft_consensus.cc:729] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.565395 20489 consensus_queue.cc:260] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.569001 20489 ts_tablet_manager.cc:1398] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240502 14:17:29.569397 20489 tablet_bootstrap.cc:492] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.569892 20490 raft_consensus.cc:482] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.570051 20490 raft_consensus.cc:504] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.570791 20490 leader_election.cc:288] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.571306 20489 tablet_bootstrap.cc:654] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.571419 20552 raft_consensus.cc:482] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.571568 20552 raft_consensus.cc:504] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.571724 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1281a87774cd4da88b6b3d87bad1bae0" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.571919 20445 raft_consensus.cc:2454] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.572278 20552 leader_election.cc:288] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.572350 20261 leader_election.cc:302] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:29.572649 20490 raft_consensus.cc:2781] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.572734 20490 raft_consensus.cc:482] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.572824 20490 raft_consensus.cc:3037] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.573805 20487 tablet_bootstrap.cc:492] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.573971 20487 ts_tablet_manager.cc:1367] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20240502 14:17:29.574735 20487 raft_consensus.cc:348] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.574942 20487 raft_consensus.cc:374] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.574997 20487 raft_consensus.cc:729] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.575253 20487 consensus_queue.cc:260] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.575706 20487 ts_tablet_manager.cc:1398] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.575628 20490 raft_consensus.cc:504] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.576830 20487 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.576769 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1281a87774cd4da88b6b3d87bad1bae0" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.576965 20371 raft_consensus.cc:3037] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.578140 20486 tablet_bootstrap.cc:492] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.578140 20489 tablet_bootstrap.cc:492] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.578380 20486 ts_tablet_manager.cc:1367] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.002s
I20240502 14:17:29.578382 20489 ts_tablet_manager.cc:1367] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20240502 14:17:29.578562 20487 tablet_bootstrap.cc:654] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.579257 20486 raft_consensus.cc:348] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.579257 20489 raft_consensus.cc:348] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.579591 20489 raft_consensus.cc:374] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.579658 20489 raft_consensus.cc:729] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.579624 20486 raft_consensus.cc:374] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.579809 20486 raft_consensus.cc:729] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.579879 20489 consensus_queue.cc:260] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.580056 20371 raft_consensus.cc:2454] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.580118 20486 consensus_queue.cc:260] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.580427 20489 ts_tablet_manager.cc:1398] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 14:17:29.580718 20489 tablet_bootstrap.cc:492] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.580973 20261 leader_election.cc:302] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.581305 20510 raft_consensus.cc:2781] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.581786 20486 ts_tablet_manager.cc:1398] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 14:17:29.582155 20486 tablet_bootstrap.cc:492] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.582360 20489 tablet_bootstrap.cc:654] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.583804 20486 tablet_bootstrap.cc:654] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.587009 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1281a87774cd4da88b6b3d87bad1bae0" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.587282 20372 raft_consensus.cc:2362] T 1281a87774cd4da88b6b3d87bad1bae0 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1. Re-sending same reply.
I20240502 14:17:29.588855 20487 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.589040 20487 ts_tablet_manager.cc:1367] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.001s
I20240502 14:17:29.589327 20489 tablet_bootstrap.cc:492] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.589481 20489 ts_tablet_manager.cc:1367] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20240502 14:17:29.589941 20486 tablet_bootstrap.cc:492] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.589851 20487 raft_consensus.cc:348] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.590123 20487 raft_consensus.cc:374] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.590198 20487 raft_consensus.cc:729] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.590327 20486 ts_tablet_manager.cc:1367] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20240502 14:17:29.590229 20489 raft_consensus.cc:348] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.590487 20489 raft_consensus.cc:374] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.590595 20489 raft_consensus.cc:729] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.590447 20487 consensus_queue.cc:260] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.590847 20489 consensus_queue.cc:260] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.591428 20486 raft_consensus.cc:348] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.591661 20486 raft_consensus.cc:374] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.591724 20486 raft_consensus.cc:729] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.591907 20486 consensus_queue.cc:260] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.592402 20486 ts_tablet_manager.cc:1398] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:29.591554 20489 ts_tablet_manager.cc:1398] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.592759 20489 tablet_bootstrap.cc:492] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.593144 20490 leader_election.cc:288] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.593681 20486 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.593758 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1281a87774cd4da88b6b3d87bad1bae0" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.593963 20445 raft_consensus.cc:3037] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.595531 20489 tablet_bootstrap.cc:654] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.595579 20486 tablet_bootstrap.cc:654] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.597175 20445 raft_consensus.cc:2454] T 1281a87774cd4da88b6b3d87bad1bae0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.599856 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e07c30ae11a43d687cdf58bfbaa6fbf" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.600196 20296 raft_consensus.cc:2454] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.602332 20487 ts_tablet_manager.cc:1398] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.013s user 0.008s sys 0.001s
I20240502 14:17:29.602303 20193 catalog_manager.cc:5484] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:29.602731 20487 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.603013 20193 catalog_manager.cc:5484] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:29.604481 20487 tablet_bootstrap.cc:654] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.609228 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e07c30ae11a43d687cdf58bfbaa6fbf" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.609570 20372 raft_consensus.cc:2454] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.610324 20410 leader_election.cc:302] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.610486 20512 raft_consensus.cc:482] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.610649 20512 raft_consensus.cc:504] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.611088 20552 raft_consensus.cc:2781] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.611176 20552 raft_consensus.cc:482] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.611246 20552 raft_consensus.cc:3037] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.611402 20512 leader_election.cc:288] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.612126 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.612339 20296 raft_consensus.cc:2454] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.612672 20336 leader_election.cc:302] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.612959 20512 raft_consensus.cc:2781] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.613051 20512 raft_consensus.cc:482] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.613122 20512 raft_consensus.cc:3037] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.614185 20552 raft_consensus.cc:504] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.615312 20552 leader_election.cc:288] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.615828 20512 raft_consensus.cc:504] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.616930 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.617128 20296 raft_consensus.cc:3037] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.617602 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e07c30ae11a43d687cdf58bfbaa6fbf" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.617779 20295 raft_consensus.cc:3037] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.619014 20512 leader_election.cc:288] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.620839 20295 raft_consensus.cc:2454] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.621397 20552 raft_consensus.cc:482] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.621457 20569 raft_consensus.cc:482] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.621662 20569 raft_consensus.cc:504] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.621603 20552 raft_consensus.cc:504] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.622502 20552 leader_election.cc:288] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.622501 20569 leader_election.cc:288] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.623592 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e07c30ae11a43d687cdf58bfbaa6fbf" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.623818 20371 raft_consensus.cc:3037] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.624082 20296 raft_consensus.cc:2454] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.624591 20336 leader_election.cc:302] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.624927 20512 raft_consensus.cc:2781] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.625851 20512 raft_consensus.cc:686] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:29.626255 20512 consensus_queue.cc:237] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.626749 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0474531a543f442394edd73dcab1c44f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.627030 20372 raft_consensus.cc:2454] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.627614 20261 leader_election.cc:302] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.627905 20569 raft_consensus.cc:2781] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.628049 20569 raft_consensus.cc:482] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.628023 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0474531a543f442394edd73dcab1c44f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.628141 20569 raft_consensus.cc:3037] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.628227 20445 raft_consensus.cc:2454] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.628901 20371 raft_consensus.cc:2454] T 5e07c30ae11a43d687cdf58bfbaa6fbf P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.631943 20569 raft_consensus.cc:504] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.632918 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.633504 20500 raft_consensus.cc:482] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.634100 20500 raft_consensus.cc:504] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.634235 20569 leader_election.cc:288] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.634872 20500 leader_election.cc:288] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.633347 20445 raft_consensus.cc:2454] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.635665 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0474531a543f442394edd73dcab1c44f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.635861 20372 raft_consensus.cc:3037] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.639477 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d42d8daf049888a825ccbe6343ee5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.640308 20569 raft_consensus.cc:482] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.640516 20569 raft_consensus.cc:504] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.639927 20295 raft_consensus.cc:2454] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.640697 20500 consensus_queue.cc:1035] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.641469 20569 leader_election.cc:288] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.641667 20552 raft_consensus.cc:482] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.641852 20552 raft_consensus.cc:504] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.642675 20552 leader_election.cc:288] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.643066 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0474531a543f442394edd73dcab1c44f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.643311 20445 raft_consensus.cc:3037] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.645406 20336 leader_election.cc:302] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.645932 20500 raft_consensus.cc:2781] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.646100 20500 raft_consensus.cc:482] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.646221 20500 raft_consensus.cc:3037] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.649330 20500 raft_consensus.cc:504] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.650173 20500 leader_election.cc:288] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.651126 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.651330 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d42d8daf049888a825ccbe6343ee5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.651566 20296 raft_consensus.cc:3037] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
W20240502 14:17:29.652089 20261 leader_election.cc:341] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.655339 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.655648 20296 raft_consensus.cc:2454] T ca2d42d8daf049888a825ccbe6343ee5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.656461 20336 leader_election.cc:302] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.656874 20500 raft_consensus.cc:2781] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.657059 20500 raft_consensus.cc:686] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
W20240502 14:17:29.657037 20261 leader_election.cc:341] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.657428 20261 leader_election.cc:302] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.657658 20500 consensus_queue.cc:237] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.657958 20569 raft_consensus.cc:2726] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.659909 20194 catalog_manager.cc:5484] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.660449 20372 raft_consensus.cc:2454] T 0474531a543f442394edd73dcab1c44f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.661129 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.661397 20446 raft_consensus.cc:3037] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.663306 20261 leader_election.cc:302] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.663739 20569 raft_consensus.cc:2781] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.663910 20569 raft_consensus.cc:686] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:29.664261 20569 consensus_queue.cc:237] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.664536 20446 raft_consensus.cc:2454] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.668021 20551 raft_consensus.cc:482] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.668272 20551 raft_consensus.cc:504] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.669247 20551 leader_election.cc:288] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.669461 20551 raft_consensus.cc:482] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.669668 20551 raft_consensus.cc:504] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.670364 20551 leader_election.cc:288] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:29.671501 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d42d8daf049888a825ccbe6343ee5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.671839 20446 raft_consensus.cc:2454] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.675034 20445 raft_consensus.cc:2454] T 0474531a543f442394edd73dcab1c44f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.676311 20444 raft_consensus.cc:3037] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.681486 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2d42d8daf049888a825ccbe6343ee5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.681653 20296 raft_consensus.cc:3037] T 5337902e81584821b6043d974664e91e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.681769 20446 raft_consensus.cc:3037] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.684689 20446 raft_consensus.cc:2454] T ca2d42d8daf049888a825ccbe6343ee5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.685411 20494 consensus_queue.cc:1035] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.685590 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2243a26fa4068aa4aa7424062292d" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.687247 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.687579 20294 raft_consensus.cc:2379] T 0e49d78d2eff446c90190e4818e95b86 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:29.687724 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2243a26fa4068aa4aa7424062292d" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.691869 20194 catalog_manager.cc:5484] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.703420 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e49d78d2eff446c90190e4818e95b86" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.704593 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14720d4da7a449b3be42bbf006da1545" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.704658 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14720d4da7a449b3be42bbf006da1545" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.704919 20297 raft_consensus.cc:2454] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.705338 20371 raft_consensus.cc:2454] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:29.706444 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36124283cbed413fb7b7e2ca9bf6e9ed" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.707594 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36124283cbed413fb7b7e2ca9bf6e9ed" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.708549 20500 consensus_queue.cc:1035] T 5337902e81584821b6043d974664e91e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.710414 20490 raft_consensus.cc:482] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.710669 20490 raft_consensus.cc:504] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.711534 20490 leader_election.cc:288] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.712561 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39456f2fe304a7495aa5a12b287355a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.712884 20446 raft_consensus.cc:2454] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.713400 20261 leader_election.cc:302] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:29.713773 20490 raft_consensus.cc:2781] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.713910 20490 raft_consensus.cc:482] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.714041 20490 raft_consensus.cc:3037] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.717545 20490 raft_consensus.cc:504] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.719667 20490 leader_election.cc:288] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.720129 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39456f2fe304a7495aa5a12b287355a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.720393 20444 raft_consensus.cc:3037] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.723982 20444 raft_consensus.cc:2454] T c39456f2fe304a7495aa5a12b287355a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.724740 20261 leader_election.cc:302] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:29.725296 20490 raft_consensus.cc:2781] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.725601 20490 raft_consensus.cc:686] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:29.726048 20490 consensus_queue.cc:237] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.727807 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39456f2fe304a7495aa5a12b287355a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.728111 20371 raft_consensus.cc:3037] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.730927 20500 consensus_queue.cc:1035] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.732174 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c39456f2fe304a7495aa5a12b287355a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.734751 20410 leader_election.cc:302] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:29.735221 20410 leader_election.cc:341] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.735663 20496 raft_consensus.cc:2781] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.735875 20496 raft_consensus.cc:686] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:29.736258 20496 consensus_queue.cc:237] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.739661 20410 leader_election.cc:302] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.741879 20510 raft_consensus.cc:686] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:29.742440 20510 consensus_queue.cc:237] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.745414 20546 raft_consensus.cc:2781] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.745594 20546 raft_consensus.cc:482] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.745723 20546 raft_consensus.cc:3037] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.749279 20546 raft_consensus.cc:504] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.750394 20546 leader_election.cc:288] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
W20240502 14:17:29.751183 20410 leader_election.cc:341] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.751402 20410 leader_election.cc:302] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.751791 20552 raft_consensus.cc:2726] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.753659 20371 raft_consensus.cc:2454] T c39456f2fe304a7495aa5a12b287355a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.755743 20372 raft_consensus.cc:3037] T 280de9137a504b0da16a5b94da293e21 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.758837 20500 raft_consensus.cc:482] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.759159 20500 raft_consensus.cc:504] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.760926 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ca5560d70b4ebaa937b4cb2fc4dffe" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
W20240502 14:17:29.761792 20336 leader_election.cc:341] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.762521 20500 leader_election.cc:288] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.764467 20410 leader_election.cc:302] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.765223 20410 leader_election.cc:302] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.768281 20193 catalog_manager.cc:5484] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.769188 20510 consensus_queue.cc:1035] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.771325 20552 raft_consensus.cc:2726] T 0e49d78d2eff446c90190e4818e95b86 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.771577 20552 raft_consensus.cc:2726] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.773226 20194 catalog_manager.cc:5484] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:29.775849 20193 catalog_manager.cc:5484] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.776502 20193 catalog_manager.cc:5484] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.783452 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14720d4da7a449b3be42bbf006da1545" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.783881 20297 raft_consensus.cc:3037] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.787830 20297 raft_consensus.cc:2454] T 14720d4da7a449b3be42bbf006da1545 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.789219 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14720d4da7a449b3be42bbf006da1545" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.789597 20370 raft_consensus.cc:3037] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.793514 20370 raft_consensus.cc:2454] T 14720d4da7a449b3be42bbf006da1545 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:29.800622 20510 raft_consensus.cc:482] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.801059 20510 raft_consensus.cc:504] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.802186 20510 leader_election.cc:288] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.803264 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30d3cdb558c479c8431e4a72f073355" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.803418 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ca5560d70b4ebaa937b4cb2fc4dffe" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:29.804214 20261 leader_election.cc:341] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.804684 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30d3cdb558c479c8431e4a72f073355" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:29.805403 20261 leader_election.cc:341] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.805644 20261 leader_election.cc:302] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.806061 20510 raft_consensus.cc:2726] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.803303 20410 leader_election.cc:302] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.806567 20546 raft_consensus.cc:2781] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
W20240502 14:17:29.807682 20336 leader_election.cc:341] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.807888 20336 leader_election.cc:302] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:29.806901 20546 raft_consensus.cc:686] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:29.808864 20546 consensus_queue.cc:237] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.809754 20500 raft_consensus.cc:2726] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:29.823971 20569 consensus_queue.cc:1035] T 280de9137a504b0da16a5b94da293e21 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.843883 20489 tablet_bootstrap.cc:492] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.844017 20486 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.843883 20487 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.844192 20489 ts_tablet_manager.cc:1367] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.251s user 0.085s sys 0.147s
I20240502 14:17:29.844264 20486 ts_tablet_manager.cc:1367] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.251s user 0.119s sys 0.091s
I20240502 14:17:29.844517 20487 ts_tablet_manager.cc:1367] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.242s user 0.080s sys 0.079s
I20240502 14:17:29.846462 20487 raft_consensus.cc:348] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.846832 20487 raft_consensus.cc:374] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.846511 20489 raft_consensus.cc:348] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.846923 20487 raft_consensus.cc:729] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.847131 20489 raft_consensus.cc:374] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.847291 20489 raft_consensus.cc:729] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.847188 20486 raft_consensus.cc:348] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.847386 20487 consensus_queue.cc:260] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.847188 20193 catalog_manager.cc:5484] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:29.847589 20486 raft_consensus.cc:374] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.847780 20486 raft_consensus.cc:729] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.847908 20489 consensus_queue.cc:260] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.848127 20486 consensus_queue.cc:260] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.848832 20489 ts_tablet_manager.cc:1398] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:29.848829 20486 ts_tablet_manager.cc:1398] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 14:17:29.849367 20489 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.849740 20487 ts_tablet_manager.cc:1398] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 14:17:29.849514 20486 tablet_bootstrap.cc:492] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.850075 20487 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.851917 20486 tablet_bootstrap.cc:654] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.851917 20487 tablet_bootstrap.cc:654] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.856034 20500 consensus_queue.cc:1035] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.853390 20489 tablet_bootstrap.cc:654] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.862105 20566 raft_consensus.cc:482] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.862426 20566 raft_consensus.cc:504] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.864100 20566 leader_election.cc:288] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.864190 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27d675ca2ff64753ae52ae207d7d9dc9" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.864498 20371 raft_consensus.cc:2454] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.865023 20261 leader_election.cc:302] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.865468 20566 raft_consensus.cc:2781] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.865635 20566 raft_consensus.cc:482] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.865789 20566 raft_consensus.cc:3037] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.866627 20489 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.866850 20489 ts_tablet_manager.cc:1367] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20240502 14:17:29.867857 20489 raft_consensus.cc:348] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.868060 20486 tablet_bootstrap.cc:492] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.868253 20489 raft_consensus.cc:374] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.868340 20486 ts_tablet_manager.cc:1367] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.012s
I20240502 14:17:29.868476 20489 raft_consensus.cc:729] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.868587 20566 raft_consensus.cc:504] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.868907 20489 consensus_queue.cc:260] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.869334 20566 leader_election.cc:288] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.869696 20489 ts_tablet_manager.cc:1398] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.866828 20487 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.870182 20486 raft_consensus.cc:348] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.870340 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27d675ca2ff64753ae52ae207d7d9dc9" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.870484 20486 raft_consensus.cc:374] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.870396 20487 ts_tablet_manager.cc:1367] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.001s
I20240502 14:17:29.870645 20446 raft_consensus.cc:2454] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.871299 20486 raft_consensus.cc:729] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.871469 20487 raft_consensus.cc:348] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.871592 20486 consensus_queue.cc:260] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.871811 20487 raft_consensus.cc:374] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.871973 20487 raft_consensus.cc:729] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.872299 20486 ts_tablet_manager.cc:1398] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:29.870002 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27d675ca2ff64753ae52ae207d7d9dc9" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.869997 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27d675ca2ff64753ae52ae207d7d9dc9" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.872298 20487 consensus_queue.cc:260] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.872689 20370 raft_consensus.cc:3037] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.873250 20487 ts_tablet_manager.cc:1398] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.873687 20487 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.874581 20486 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.875994 20487 tablet_bootstrap.cc:654] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.876225 20370 raft_consensus.cc:2454] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.876335 20445 raft_consensus.cc:3037] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.876763 20261 leader_election.cc:302] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.877094 20566 raft_consensus.cc:2781] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.877286 20566 raft_consensus.cc:686] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:29.870182 20489 tablet_bootstrap.cc:492] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.877404 20486 tablet_bootstrap.cc:654] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.877754 20566 consensus_queue.cc:237] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.891844 20512 consensus_queue.cc:1035] T cc414b64340d4b92a9fd283fcfb142e7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.894151 20487 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.900281 20445 raft_consensus.cc:2454] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.902398 20487 ts_tablet_manager.cc:1367] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20240502 14:17:29.903975 20489 tablet_bootstrap.cc:654] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.909721 20487 raft_consensus.cc:348] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.910055 20487 raft_consensus.cc:374] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.910161 20487 raft_consensus.cc:729] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.910638 20487 consensus_queue.cc:260] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.910635 20193 catalog_manager.cc:5484] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.911294 20487 ts_tablet_manager.cc:1398] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20240502 14:17:29.911715 20487 tablet_bootstrap.cc:492] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.913673 20487 tablet_bootstrap.cc:654] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.915397 20486 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.915625 20486 ts_tablet_manager.cc:1367] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.041s user 0.010s sys 0.021s
I20240502 14:17:29.916352 20486 raft_consensus.cc:348] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.916594 20486 raft_consensus.cc:374] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.916692 20486 raft_consensus.cc:729] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.916961 20486 consensus_queue.cc:260] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.919098 20486 ts_tablet_manager.cc:1398] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:17:29.919533 20486 tablet_bootstrap.cc:492] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.922317 20486 tablet_bootstrap.cc:654] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.923687 20489 tablet_bootstrap.cc:492] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.923943 20489 ts_tablet_manager.cc:1367] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.003s
I20240502 14:17:29.924922 20489 raft_consensus.cc:348] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.925237 20489 raft_consensus.cc:374] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.925329 20489 raft_consensus.cc:729] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.925652 20489 consensus_queue.cc:260] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.926357 20489 ts_tablet_manager.cc:1398] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:29.926911 20489 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.929217 20489 tablet_bootstrap.cc:654] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.930765 20486 tablet_bootstrap.cc:492] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.930961 20486 ts_tablet_manager.cc:1367] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20240502 14:17:29.931602 20487 tablet_bootstrap.cc:492] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.931789 20487 ts_tablet_manager.cc:1367] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.006s
I20240502 14:17:29.931720 20486 raft_consensus.cc:348] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.931921 20486 raft_consensus.cc:374] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.932008 20486 raft_consensus.cc:729] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.932237 20486 consensus_queue.cc:260] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.933753 20486 ts_tablet_manager.cc:1398] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:29.933712 20487 raft_consensus.cc:348] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.933960 20487 raft_consensus.cc:374] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.934075 20487 raft_consensus.cc:729] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.934120 20486 tablet_bootstrap.cc:492] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.934345 20487 consensus_queue.cc:260] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.935173 20487 ts_tablet_manager.cc:1398] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:29.935425 20566 raft_consensus.cc:482] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.935575 20487 tablet_bootstrap.cc:492] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.935606 20566 raft_consensus.cc:504] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.936321 20566 leader_election.cc:288] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.936522 20486 tablet_bootstrap.cc:654] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.937412 20487 tablet_bootstrap.cc:654] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.937387 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "258d15b6ad4e4416b745eeed7cb3c757" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:29.938141 20489 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
W20240502 14:17:29.938401 20261 leader_election.cc:341] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.938401 20489 ts_tablet_manager.cc:1367] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20240502 14:17:29.939690 20489 raft_consensus.cc:348] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.939958 20489 raft_consensus.cc:374] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.940055 20489 raft_consensus.cc:729] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.940343 20489 consensus_queue.cc:260] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.941013 20489 ts_tablet_manager.cc:1398] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:29.941414 20489 tablet_bootstrap.cc:492] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:29.943703 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "258d15b6ad4e4416b745eeed7cb3c757" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.944151 20446 raft_consensus.cc:2454] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:29.944751 20261 leader_election.cc:302] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.945389 20566 raft_consensus.cc:2781] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.945526 20566 raft_consensus.cc:482] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.945638 20566 raft_consensus.cc:3037] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.949121 20566 raft_consensus.cc:504] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.949597 20486 tablet_bootstrap.cc:492] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.949819 20486 ts_tablet_manager.cc:1367] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.006s
I20240502 14:17:29.950631 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "258d15b6ad4e4416b745eeed7cb3c757" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:29.950784 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "258d15b6ad4e4416b745eeed7cb3c757" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.950861 20486 raft_consensus.cc:348] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.951009 20446 raft_consensus.cc:3037] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.951110 20486 raft_consensus.cc:374] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.951201 20486 raft_consensus.cc:729] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.951516 20486 consensus_queue.cc:260] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:29.951735 20261 leader_election.cc:341] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:29.953159 20486 ts_tablet_manager.cc:1398] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:29.953547 20486 tablet_bootstrap.cc:492] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.953840 20566 leader_election.cc:288] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.954469 20446 raft_consensus.cc:2454] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:29.955096 20261 leader_election.cc:302] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:29.955586 20566 raft_consensus.cc:2781] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.955744 20486 tablet_bootstrap.cc:654] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.956122 20566 raft_consensus.cc:686] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:29.956461 20566 consensus_queue.cc:237] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.943682 20489 tablet_bootstrap.cc:654] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.963111 20512 raft_consensus.cc:482] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:29.963594 20512 raft_consensus.cc:504] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.968183 20512 leader_election.cc:288] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.968763 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13319c6da9c4e6db72f64f500fc28d5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:29.969770 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13319c6da9c4e6db72f64f500fc28d5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:29.970100 20446 raft_consensus.cc:2454] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.970827 20336 leader_election.cc:302] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.970497 20194 catalog_manager.cc:5484] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:29.971546 20512 raft_consensus.cc:2781] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:29.971710 20512 raft_consensus.cc:482] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:29.971812 20512 raft_consensus.cc:3037] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.973656 20297 raft_consensus.cc:2454] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:29.975018 20487 tablet_bootstrap.cc:492] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:29.975405 20487 ts_tablet_manager.cc:1367] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.040s user 0.014s sys 0.024s
I20240502 14:17:29.976572 20512 raft_consensus.cc:504] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.976586 20487 raft_consensus.cc:348] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.977344 20487 raft_consensus.cc:374] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.977483 20487 raft_consensus.cc:729] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.977798 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13319c6da9c4e6db72f64f500fc28d5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:29.977830 20487 consensus_queue.cc:260] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.977339 20512 leader_election.cc:288] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:29.978051 20297 raft_consensus.cc:3037] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.978030 20489 tablet_bootstrap.cc:492] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:29.978315 20489 ts_tablet_manager.cc:1367] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.001s
I20240502 14:17:29.978479 20487 ts_tablet_manager.cc:1398] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.978884 20487 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:29.979068 20486 tablet_bootstrap.cc:492] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:29.979302 20486 ts_tablet_manager.cc:1367] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.012s
I20240502 14:17:29.979326 20489 raft_consensus.cc:348] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.979640 20489 raft_consensus.cc:374] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.979804 20489 raft_consensus.cc:729] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.980170 20489 consensus_queue.cc:260] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.980868 20487 tablet_bootstrap.cc:654] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.980813 20486 raft_consensus.cc:348] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.981137 20486 raft_consensus.cc:374] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:29.981225 20297 raft_consensus.cc:2454] T d13319c6da9c4e6db72f64f500fc28d5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:29.981375 20486 raft_consensus.cc:729] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:29.981724 20486 consensus_queue.cc:260] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.982439 20486 ts_tablet_manager.cc:1398] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:29.981832 20336 leader_election.cc:302] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:29.983227 20494 raft_consensus.cc:2781] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:29.983415 20494 raft_consensus.cc:686] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:29.983811 20486 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:29.983749 20494 consensus_queue.cc:237] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:29.984266 20489 ts_tablet_manager.cc:1398] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 14:17:29.986078 20486 tablet_bootstrap.cc:654] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:29.986045 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d13319c6da9c4e6db72f64f500fc28d5" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:29.986634 20446 raft_consensus.cc:3037] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:29.988831 20546 consensus_queue.cc:1035] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:29.990500 20446 raft_consensus.cc:2454] T d13319c6da9c4e6db72f64f500fc28d5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.000044 20489 tablet_bootstrap.cc:492] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.003293 20193 catalog_manager.cc:5484] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.011386 20487 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.011606 20487 ts_tablet_manager.cc:1367] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.023s
I20240502 14:17:30.012353 20487 raft_consensus.cc:348] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.012568 20487 raft_consensus.cc:374] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.012670 20487 raft_consensus.cc:729] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.012961 20487 consensus_queue.cc:260] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.013645 20487 ts_tablet_manager.cc:1398] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.013921 20566 raft_consensus.cc:482] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.014075 20566 raft_consensus.cc:504] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.014922 20566 leader_election.cc:288] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.015379 20551 consensus_queue.cc:1035] T 43f64edf80f7483f862c2175acf7fcd0 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.015749 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.016090 20487 tablet_bootstrap.cc:492] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.015759 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:30.016749 20261 leader_election.cc:341] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:30.017000 20261 leader_election.cc:341] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.017119 20261 leader_election.cc:302] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.017666 20566 raft_consensus.cc:2726] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.018250 20487 tablet_bootstrap.cc:654] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
W20240502 14:17:30.025808 20243 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:17:30.027812 20487 tablet_bootstrap.cc:492] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.028050 20487 ts_tablet_manager.cc:1367] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20240502 14:17:30.028839 20487 raft_consensus.cc:348] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.029091 20487 raft_consensus.cc:374] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.029188 20487 raft_consensus.cc:729] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.029476 20487 consensus_queue.cc:260] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.030145 20487 ts_tablet_manager.cc:1398] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.030700 20487 tablet_bootstrap.cc:492] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.032780 20487 tablet_bootstrap.cc:654] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.033958 20512 raft_consensus.cc:482] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.034135 20512 raft_consensus.cc:504] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.034868 20512 leader_election.cc:288] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.036499 20512 consensus_queue.cc:1035] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.036636 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cce88b36f4e47fdb1f4588104c2917e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:30.038183 20336 leader_election.cc:341] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.038895 20487 tablet_bootstrap.cc:492] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.039080 20487 ts_tablet_manager.cc:1367] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20240502 14:17:30.039824 20512 consensus_queue.cc:1035] T 0e49d78d2eff446c90190e4818e95b86 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.039973 20487 raft_consensus.cc:348] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.040176 20487 raft_consensus.cc:374] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.040282 20487 raft_consensus.cc:729] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.040531 20487 consensus_queue.cc:260] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.041179 20487 ts_tablet_manager.cc:1398] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:30.042177 20487 tablet_bootstrap.cc:492] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.044584 20487 tablet_bootstrap.cc:654] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.045711 20512 consensus_queue.cc:1035] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240502 14:17:30.049458 20494 raft_consensus.cc:482] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.049775 20494 raft_consensus.cc:504] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.050904 20494 leader_election.cc:288] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.052053 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6df1c0367904b059bb0c07e74314c74" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.052069 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6df1c0367904b059bb0c07e74314c74" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.052455 20296 raft_consensus.cc:2454] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.053153 20336 leader_election.cc:302] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:30.053671 20336 leader_election.cc:341] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.054328 20494 raft_consensus.cc:2781] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.054685 20494 raft_consensus.cc:482] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.054824 20494 raft_consensus.cc:3037] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.059212 20494 raft_consensus.cc:504] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.061069 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6df1c0367904b059bb0c07e74314c74" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.061460 20296 raft_consensus.cc:3037] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.064747 20551 consensus_queue.cc:1035] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.065848 20296 raft_consensus.cc:2454] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.066725 20336 leader_election.cc:302] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.067224 20500 raft_consensus.cc:2781] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.067384 20500 raft_consensus.cc:686] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.067770 20500 consensus_queue.cc:237] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.071436 20551 consensus_queue.cc:1035] T 178abc14522d436bbdf38744d5897c72 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.074601 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6df1c0367904b059bb0c07e74314c74" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
W20240502 14:17:30.075492 20336 leader_election.cc:341] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.076270 20494 leader_election.cc:288] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.054028 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cce88b36f4e47fdb1f4588104c2917e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.081568 20295 raft_consensus.cc:2454] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.083290 20336 leader_election.cc:302] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.083969 20494 raft_consensus.cc:2781] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.084105 20494 raft_consensus.cc:482] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.084249 20494 raft_consensus.cc:3037] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.095180 20620 consensus_queue.cc:1035] T ca2d42d8daf049888a825ccbe6343ee5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.096880 20566 raft_consensus.cc:482] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.097071 20566 raft_consensus.cc:504] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.097815 20566 leader_election.cc:288] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.098896 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf758a9a8314106bcb1ed7abb8cc220" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:30.100400 20261 leader_election.cc:341] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.100425 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf758a9a8314106bcb1ed7abb8cc220" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.100818 20566 raft_consensus.cc:482] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.100988 20566 raft_consensus.cc:504] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:30.101130 20261 leader_election.cc:341] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.101259 20261 leader_election.cc:302] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.101576 20510 raft_consensus.cc:2726] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.101725 20566 leader_election.cc:288] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.102550 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ca5560d70b4ebaa937b4cb2fc4dffe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.102799 20371 raft_consensus.cc:2454] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.102563 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ca5560d70b4ebaa937b4cb2fc4dffe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.103577 20444 raft_consensus.cc:2454] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.104132 20261 leader_election.cc:302] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.104830 20566 raft_consensus.cc:2781] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.104928 20566 raft_consensus.cc:482] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.104990 20566 raft_consensus.cc:3037] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.108165 20546 consensus_queue.cc:1035] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.108867 20566 raft_consensus.cc:504] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.109880 20566 leader_election.cc:288] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.110843 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ca5560d70b4ebaa937b4cb2fc4dffe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.111069 20371 raft_consensus.cc:3037] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.115562 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20ca5560d70b4ebaa937b4cb2fc4dffe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.116014 20444 raft_consensus.cc:3037] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.121526 20489 tablet_bootstrap.cc:654] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.122329 20192 catalog_manager.cc:5484] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.134402 20444 raft_consensus.cc:2454] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.114518 20371 raft_consensus.cc:2454] T 20ca5560d70b4ebaa937b4cb2fc4dffe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.135550 20500 raft_consensus.cc:482] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.135718 20500 raft_consensus.cc:504] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.136335 20510 raft_consensus.cc:482] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.136490 20510 raft_consensus.cc:504] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.137082 20500 leader_election.cc:288] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.137151 20510 leader_election.cc:288] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.137624 20261 leader_election.cc:302] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.137956 20510 raft_consensus.cc:2781] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.138073 20510 raft_consensus.cc:686] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:30.138371 20510 consensus_queue.cc:237] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.141541 20551 consensus_queue.cc:1035] T 14dd72fc610048cfb635bac34dec59a7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.142957 20489 tablet_bootstrap.cc:492] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.143159 20489 ts_tablet_manager.cc:1367] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.143s user 0.005s sys 0.000s
I20240502 14:17:30.143699 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2243a26fa4068aa4aa7424062292d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.144176 20489 raft_consensus.cc:348] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.145812 20551 consensus_queue.cc:1035] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.147413 20444 raft_consensus.cc:2454] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.147583 20489 raft_consensus.cc:374] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.148417 20489 raft_consensus.cc:729] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.148720 20489 consensus_queue.cc:260] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.149089 20336 leader_election.cc:302] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.149408 20500 raft_consensus.cc:2781] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.149509 20500 raft_consensus.cc:482] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.149586 20500 raft_consensus.cc:3037] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.150790 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "984c1d6e64e84bcdb9f5644b8d8a3565" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.151624 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2243a26fa4068aa4aa7424062292d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.151619 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "984c1d6e64e84bcdb9f5644b8d8a3565" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.151857 20294 raft_consensus.cc:2454] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
W20240502 14:17:30.152225 20261 leader_election.cc:341] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:30.153069 20261 leader_election.cc:341] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.153204 20261 leader_election.cc:302] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.153803 20490 consensus_queue.cc:1035] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240502 14:17:30.154388 20566 raft_consensus.cc:2726] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.154896 20489 ts_tablet_manager.cc:1398] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20240502 14:17:30.155308 20489 tablet_bootstrap.cc:492] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.156319 20494 raft_consensus.cc:504] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.158344 20494 leader_election.cc:288] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.157608 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cce88b36f4e47fdb1f4588104c2917e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.158653 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cce88b36f4e47fdb1f4588104c2917e" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.158756 20296 raft_consensus.cc:3037] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
W20240502 14:17:30.159193 20336 leader_election.cc:341] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.169601 20296 raft_consensus.cc:2454] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.170365 20336 leader_election.cc:302] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.172606 20494 raft_consensus.cc:2781] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.173607 20494 raft_consensus.cc:686] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.173975 20494 consensus_queue.cc:237] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.179543 20489 tablet_bootstrap.cc:654] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.179690 20486 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.179888 20486 ts_tablet_manager.cc:1367] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.196s user 0.047s sys 0.069s
I20240502 14:17:30.180500 20546 consensus_queue.cc:1035] T 5e07c30ae11a43d687cdf58bfbaa6fbf P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.182376 20486 raft_consensus.cc:348] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.182682 20486 raft_consensus.cc:374] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.182742 20486 raft_consensus.cc:729] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.182976 20486 consensus_queue.cc:260] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.183593 20486 ts_tablet_manager.cc:1398] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:30.184437 20569 consensus_queue.cc:1035] T 0474531a543f442394edd73dcab1c44f P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.190793 20486 tablet_bootstrap.cc:492] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.202489 20500 raft_consensus.cc:504] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.203606 20486 tablet_bootstrap.cc:654] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.207867 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2243a26fa4068aa4aa7424062292d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.208027 20500 leader_election.cc:288] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.208124 20293 raft_consensus.cc:3037] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.208401 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2243a26fa4068aa4aa7424062292d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.210184 20444 raft_consensus.cc:3037] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.222785 20293 raft_consensus.cc:2454] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.223573 20336 leader_election.cc:302] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.223959 20500 raft_consensus.cc:2781] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.224098 20500 raft_consensus.cc:686] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.224416 20500 consensus_queue.cc:237] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.227769 20444 raft_consensus.cc:2454] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.247468 20487 tablet_bootstrap.cc:492] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.247783 20487 ts_tablet_manager.cc:1367] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.206s user 0.083s sys 0.101s
I20240502 14:17:30.248788 20487 raft_consensus.cc:348] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.249188 20487 raft_consensus.cc:374] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.249317 20487 raft_consensus.cc:729] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.249672 20487 consensus_queue.cc:260] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.250324 20487 ts_tablet_manager.cc:1398] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.251940 20489 tablet_bootstrap.cc:492] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.251789 20192 catalog_manager.cc:5484] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.252091 20489 ts_tablet_manager.cc:1367] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.097s user 0.011s sys 0.005s
I20240502 14:17:30.252815 20489 raft_consensus.cc:348] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.253005 20489 raft_consensus.cc:374] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.253072 20489 raft_consensus.cc:729] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.253312 20489 consensus_queue.cc:260] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.254611 20486 tablet_bootstrap.cc:492] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.254942 20486 ts_tablet_manager.cc:1367] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.064s user 0.014s sys 0.005s
I20240502 14:17:30.255646 20486 raft_consensus.cc:348] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.255798 20489 ts_tablet_manager.cc:1398] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 14:17:30.255894 20486 raft_consensus.cc:374] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.255950 20486 raft_consensus.cc:729] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.256155 20489 tablet_bootstrap.cc:492] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.256435 20193 catalog_manager.cc:5484] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.257123 20487 tablet_bootstrap.cc:492] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.256171 20486 consensus_queue.cc:260] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.258965 20486 ts_tablet_manager.cc:1398] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:30.259186 20489 tablet_bootstrap.cc:654] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.259255 20486 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.261610 20192 catalog_manager.cc:5484] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.262174 20487 tablet_bootstrap.cc:654] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.263280 20486 tablet_bootstrap.cc:654] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.268374 20487 tablet_bootstrap.cc:492] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.268734 20487 ts_tablet_manager.cc:1367] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20240502 14:17:30.269661 20487 raft_consensus.cc:348] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.270041 20487 raft_consensus.cc:374] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.270155 20487 raft_consensus.cc:729] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.270522 20487 consensus_queue.cc:260] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.271132 20487 ts_tablet_manager.cc:1398] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:30.271617 20487 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.271744 20486 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.271885 20486 ts_tablet_manager.cc:1367] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20240502 14:17:30.272676 20486 raft_consensus.cc:348] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.272902 20486 raft_consensus.cc:374] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.272980 20486 raft_consensus.cc:729] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.273247 20486 consensus_queue.cc:260] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.274022 20489 tablet_bootstrap.cc:492] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.274258 20489 ts_tablet_manager.cc:1367] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.003s
I20240502 14:17:30.274653 20486 ts_tablet_manager.cc:1398] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 14:17:30.274706 20546 raft_consensus.cc:482] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.274982 20486 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.274859 20546 raft_consensus.cc:504] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.275617 20487 tablet_bootstrap.cc:654] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.275658 20546 leader_election.cc:288] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.276603 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a677e91ff17845bda5bce77bf3d5de22" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.276611 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a677e91ff17845bda5bce77bf3d5de22" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.276854 20297 raft_consensus.cc:2454] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.276865 20370 raft_consensus.cc:2454] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.277545 20410 leader_election.cc:302] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.277714 20489 raft_consensus.cc:348] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.277928 20489 raft_consensus.cc:374] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.278005 20489 raft_consensus.cc:729] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.278303 20546 raft_consensus.cc:2781] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.278236 20489 consensus_queue.cc:260] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.278399 20546 raft_consensus.cc:482] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.278465 20546 raft_consensus.cc:3037] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.280040 20489 ts_tablet_manager.cc:1398] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 14:17:30.280385 20489 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.281747 20546 raft_consensus.cc:504] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.282275 20489 tablet_bootstrap.cc:654] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.283036 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a677e91ff17845bda5bce77bf3d5de22" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.283268 20297 raft_consensus.cc:3037] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.283989 20546 leader_election.cc:288] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.284739 20486 tablet_bootstrap.cc:654] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.285334 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a677e91ff17845bda5bce77bf3d5de22" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.285596 20370 raft_consensus.cc:3037] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.286372 20297 raft_consensus.cc:2454] T a677e91ff17845bda5bce77bf3d5de22 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.288503 20410 leader_election.cc:302] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.289853 20546 raft_consensus.cc:2781] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.290134 20546 raft_consensus.cc:686] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:30.291451 20569 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.291980 20569 consensus_queue.cc:1035] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.290455 20546 consensus_queue.cc:237] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.293653 20370 raft_consensus.cc:2454] T a677e91ff17845bda5bce77bf3d5de22 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.297643 20569 consensus_queue.cc:1035] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240502 14:17:30.305019 20569 consensus_queue.cc:1035] T c39456f2fe304a7495aa5a12b287355a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.309144 20552 consensus_queue.cc:1035] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.314728 20552 raft_consensus.cc:482] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.315033 20552 raft_consensus.cc:504] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.322420 20552 leader_election.cc:288] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.323248 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6df1c0367904b059bb0c07e74314c74" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.323596 20293 raft_consensus.cc:2379] T f6df1c0367904b059bb0c07e74314c74 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:30.324678 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6df1c0367904b059bb0c07e74314c74" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.325472 20410 leader_election.cc:302] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.325834 20552 raft_consensus.cc:3037] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.326988 20621 raft_consensus.cc:482] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.327142 20621 raft_consensus.cc:504] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.328012 20621 leader_election.cc:288] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.328811 20552 raft_consensus.cc:2726] T f6df1c0367904b059bb0c07e74314c74 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.329870 20486 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.330070 20486 ts_tablet_manager.cc:1367] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.021s
I20240502 14:17:30.330972 20486 raft_consensus.cc:348] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.331245 20486 raft_consensus.cc:374] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.331364 20486 raft_consensus.cc:729] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.331526 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.331656 20486 consensus_queue.cc:260] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.332509 20486 ts_tablet_manager.cc:1398] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20240502 14:17:30.332480 20336 leader_election.cc:341] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.333012 20486 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.333694 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.333976 20293 raft_consensus.cc:2454] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.334698 20336 leader_election.cc:302] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.335042 20621 raft_consensus.cc:2781] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.335176 20621 raft_consensus.cc:482] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.335765 20621 raft_consensus.cc:3037] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.342741 20487 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.342485 20194 catalog_manager.cc:5484] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:30.354027 20489 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.355382 20486 tablet_bootstrap.cc:654] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.355857 20500 raft_consensus.cc:482] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.356047 20500 raft_consensus.cc:504] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.357079 20500 leader_election.cc:288] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.357240 20621 raft_consensus.cc:504] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.359695 20510 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240502 14:17:30.360302 20490 consensus_queue.cc:1035] T 1281a87774cd4da88b6b3d87bad1bae0 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240502 14:17:30.361719 20487 ts_tablet_manager.cc:1367] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.071s user 0.017s sys 0.033s
I20240502 14:17:30.361662 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.362156 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.363408 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.363903 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.364296 20489 ts_tablet_manager.cc:1367] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.003s
I20240502 14:17:30.364259 20546 consensus_queue.cc:1035] T 14720d4da7a449b3be42bbf006da1545 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.364917 20296 raft_consensus.cc:3037] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.365280 20489 raft_consensus.cc:348] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.365679 20489 raft_consensus.cc:374] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.365811 20489 raft_consensus.cc:729] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.366084 20489 consensus_queue.cc:260] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.366891 20293 raft_consensus.cc:2454] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
W20240502 14:17:30.366853 20336 leader_election.cc:341] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.367533 20336 leader_election.cc:302] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:30.367944 20336 leader_election.cc:341] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.368291 20296 raft_consensus.cc:2454] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.368661 20500 raft_consensus.cc:2781] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.368795 20500 raft_consensus.cc:482] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.368908 20500 raft_consensus.cc:3037] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.363471 20621 leader_election.cc:288] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.378002 20487 raft_consensus.cc:348] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.379884 20489 ts_tablet_manager.cc:1398] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.381543 20336 leader_election.cc:302] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.385139 20487 raft_consensus.cc:374] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.388509 20487 raft_consensus.cc:729] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.388468 20489 tablet_bootstrap.cc:492] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.389570 20500 raft_consensus.cc:504] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.390425 20500 leader_election.cc:288] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.390614 20621 raft_consensus.cc:2781] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.393077 20487 consensus_queue.cc:260] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.394045 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.394476 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.394762 20621 raft_consensus.cc:686] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.397673 20293 raft_consensus.cc:3037] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.397941 20486 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.398522 20487 ts_tablet_manager.cc:1398] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20240502 14:17:30.399223 20489 tablet_bootstrap.cc:654] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.400466 20512 raft_consensus.cc:482] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.400959 20512 raft_consensus.cc:504] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.402864 20293 raft_consensus.cc:2454] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.405073 20486 ts_tablet_manager.cc:1367] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.008s
W20240502 14:17:30.405174 20336 leader_election.cc:341] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.405970 20336 leader_election.cc:302] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.406345 20486 raft_consensus.cc:348] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.406602 20500 raft_consensus.cc:2781] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.406756 20486 raft_consensus.cc:374] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.406813 20500 raft_consensus.cc:686] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.405936 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "258d15b6ad4e4416b745eeed7cb3c757" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.407270 20500 consensus_queue.cc:237] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.405105 20621 consensus_queue.cc:237] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.410169 20487 tablet_bootstrap.cc:492] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.410213 20512 leader_election.cc:288] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.411033 20486 raft_consensus.cc:729] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.411623 20486 consensus_queue.cc:260] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.412236 20487 tablet_bootstrap.cc:654] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.413081 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "258d15b6ad4e4416b745eeed7cb3c757" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.413379 20444 raft_consensus.cc:2379] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
I20240502 14:17:30.415155 20486 ts_tablet_manager.cc:1398] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20240502 14:17:30.416472 20489 tablet_bootstrap.cc:492] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.416532 20487 tablet_bootstrap.cc:492] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.416728 20489 ts_tablet_manager.cc:1367] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.006s
I20240502 14:17:30.416733 20487 ts_tablet_manager.cc:1367] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20240502 14:17:30.417344 20336 leader_election.cc:302] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.417641 20487 raft_consensus.cc:348] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.417878 20621 raft_consensus.cc:3037] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.417919 20487 raft_consensus.cc:374] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.417753 20489 raft_consensus.cc:348] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.418025 20487 raft_consensus.cc:729] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.418032 20489 raft_consensus.cc:374] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.418177 20489 raft_consensus.cc:729] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.418327 20487 consensus_queue.cc:260] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.418438 20489 consensus_queue.cc:260] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.420166 20487 ts_tablet_manager.cc:1398] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:30.420593 20487 tablet_bootstrap.cc:492] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.421028 20621 raft_consensus.cc:2726] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.416770 20486 tablet_bootstrap.cc:492] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.425558 20489 ts_tablet_manager.cc:1398] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 14:17:30.426082 20489 tablet_bootstrap.cc:492] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.426281 20621 consensus_queue.cc:1035] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240502 14:17:30.427678 20487 tablet_bootstrap.cc:654] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.427837 20489 tablet_bootstrap.cc:654] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.430114 20486 tablet_bootstrap.cc:654] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.429039 20193 catalog_manager.cc:5484] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.431154 20193 catalog_manager.cc:5484] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.436094 20489 tablet_bootstrap.cc:492] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.436383 20489 ts_tablet_manager.cc:1367] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20240502 14:17:30.437302 20489 raft_consensus.cc:348] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.437621 20489 raft_consensus.cc:374] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.437716 20489 raft_consensus.cc:729] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.438342 20489 consensus_queue.cc:260] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.440555 20489 ts_tablet_manager.cc:1398] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 14:17:30.440580 20569 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.441228 20489 tablet_bootstrap.cc:492] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.442973 20489 tablet_bootstrap.cc:654] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.447860 20566 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.450582 20486 tablet_bootstrap.cc:492] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.450806 20486 ts_tablet_manager.cc:1367] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.004s
I20240502 14:17:30.450922 20487 tablet_bootstrap.cc:492] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.451522 20487 ts_tablet_manager.cc:1367] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.004s
I20240502 14:17:30.451987 20486 raft_consensus.cc:348] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.452245 20486 raft_consensus.cc:374] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.452373 20486 raft_consensus.cc:729] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.452368 20487 raft_consensus.cc:348] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.452643 20487 raft_consensus.cc:374] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.452785 20487 raft_consensus.cc:729] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.452742 20486 consensus_queue.cc:260] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.453044 20487 consensus_queue.cc:260] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.453438 20486 ts_tablet_manager.cc:1398] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.453755 20487 ts_tablet_manager.cc:1398] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.453784 20486 tablet_bootstrap.cc:492] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.454161 20489 tablet_bootstrap.cc:492] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.454316 20489 ts_tablet_manager.cc:1367] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20240502 14:17:30.454396 20500 consensus_queue.cc:1035] T d13319c6da9c4e6db72f64f500fc28d5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.455113 20489 raft_consensus.cc:348] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.455330 20489 raft_consensus.cc:374] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.455451 20489 raft_consensus.cc:729] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.455720 20489 consensus_queue.cc:260] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.455942 20487 tablet_bootstrap.cc:492] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.456313 20489 ts_tablet_manager.cc:1398] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:30.456609 20489 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.457641 20487 tablet_bootstrap.cc:654] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.458169 20489 tablet_bootstrap.cc:654] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.464519 20486 tablet_bootstrap.cc:654] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.467731 20489 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.468003 20489 ts_tablet_manager.cc:1367] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.002s
I20240502 14:17:30.468822 20489 raft_consensus.cc:348] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.469077 20489 raft_consensus.cc:374] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.469167 20489 raft_consensus.cc:729] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.469437 20489 consensus_queue.cc:260] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.470118 20489 ts_tablet_manager.cc:1398] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:30.470484 20489 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.472012 20566 raft_consensus.cc:482] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.472241 20566 raft_consensus.cc:504] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.472649 20489 tablet_bootstrap.cc:654] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.473086 20566 leader_election.cc:288] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.473922 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f956dfc843814ccd92546e00110c79ca" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.474609 20486 tablet_bootstrap.cc:492] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.474812 20486 ts_tablet_manager.cc:1367] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20240502 14:17:30.474967 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f956dfc843814ccd92546e00110c79ca" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.475224 20371 raft_consensus.cc:2454] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.475824 20261 leader_election.cc:302] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:30.476253 20261 leader_election.cc:341] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.475602 20486 raft_consensus.cc:348] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.476634 20486 raft_consensus.cc:374] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.476732 20486 raft_consensus.cc:729] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.477011 20486 consensus_queue.cc:260] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.477663 20486 ts_tablet_manager.cc:1398] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 14:17:30.478129 20487 tablet_bootstrap.cc:492] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.477162 20566 raft_consensus.cc:2781] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.478288 20486 tablet_bootstrap.cc:492] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.478346 20566 raft_consensus.cc:482] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.478336 20487 ts_tablet_manager.cc:1367] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.012s
I20240502 14:17:30.480149 20566 raft_consensus.cc:3037] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.482064 20546 raft_consensus.cc:482] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.482826 20546 raft_consensus.cc:504] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.483464 20566 raft_consensus.cc:504] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.483623 20546 leader_election.cc:288] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.483630 20489 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.484344 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cce88b36f4e47fdb1f4588104c2917e" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.484354 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cce88b36f4e47fdb1f4588104c2917e" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.484740 20293 raft_consensus.cc:2379] T 6cce88b36f4e47fdb1f4588104c2917e P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:30.484710 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f956dfc843814ccd92546e00110c79ca" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.484830 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f956dfc843814ccd92546e00110c79ca" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.484911 20370 raft_consensus.cc:3037] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.485105 20410 leader_election.cc:302] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.485088 20487 raft_consensus.cc:348] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:30.485318 20261 leader_election.cc:341] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.485388 20566 leader_election.cc:288] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.485975 20546 raft_consensus.cc:3037] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.486050 20486 tablet_bootstrap.cc:654] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.485318 20487 raft_consensus.cc:374] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.486718 20487 raft_consensus.cc:729] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.487043 20487 consensus_queue.cc:260] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.488425 20489 ts_tablet_manager.cc:1367] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.006s
I20240502 14:17:30.488571 20370 raft_consensus.cc:2454] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.489235 20261 leader_election.cc:302] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.489549 20546 raft_consensus.cc:2726] T 6cce88b36f4e47fdb1f4588104c2917e P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.490033 20566 raft_consensus.cc:2781] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.490309 20487 ts_tablet_manager.cc:1398] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240502 14:17:30.490722 20487 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.490425 20566 raft_consensus.cc:686] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:30.490365 20489 raft_consensus.cc:348] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.491122 20486 tablet_bootstrap.cc:492] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.491755 20486 ts_tablet_manager.cc:1367] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.001s
I20240502 14:17:30.491688 20566 consensus_queue.cc:237] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.492785 20489 raft_consensus.cc:374] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.492991 20489 raft_consensus.cc:729] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.493320 20489 consensus_queue.cc:260] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.493803 20487 tablet_bootstrap.cc:654] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.493829 20486 raft_consensus.cc:348] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.494104 20486 raft_consensus.cc:374] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.494216 20486 raft_consensus.cc:729] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.494488 20546 raft_consensus.cc:482] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.494464 20486 consensus_queue.cc:260] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.494664 20546 raft_consensus.cc:504] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.496299 20486 ts_tablet_manager.cc:1398] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 14:17:30.497332 20546 leader_election.cc:288] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.497768 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fd8e3c3abe4260bfeccff24fbfb20d" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.497690 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fd8e3c3abe4260bfeccff24fbfb20d" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.499598 20486 tablet_bootstrap.cc:492] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.499594 20370 raft_consensus.cc:2454] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.499594 20487 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.500068 20293 raft_consensus.cc:2454] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.500125 20410 leader_election.cc:302] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.500449 20546 raft_consensus.cc:2781] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.500566 20546 raft_consensus.cc:482] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.500315 20194 catalog_manager.cc:5484] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.500656 20546 raft_consensus.cc:3037] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.501435 20486 tablet_bootstrap.cc:654] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.502302 20489 ts_tablet_manager.cc:1398] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240502 14:17:30.503650 20546 raft_consensus.cc:504] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.504297 20489 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.504431 20546 leader_election.cc:288] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.504638 20487 ts_tablet_manager.cc:1367] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20240502 14:17:30.505131 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fd8e3c3abe4260bfeccff24fbfb20d" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.505370 20293 raft_consensus.cc:3037] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.505594 20487 raft_consensus.cc:348] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.505854 20487 raft_consensus.cc:374] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.505946 20487 raft_consensus.cc:729] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.506022 20489 tablet_bootstrap.cc:654] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.506242 20487 consensus_queue.cc:260] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.506966 20487 ts_tablet_manager.cc:1398] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.507570 20487 tablet_bootstrap.cc:492] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.508380 20293 raft_consensus.cc:2454] T 34fd8e3c3abe4260bfeccff24fbfb20d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.508893 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fd8e3c3abe4260bfeccff24fbfb20d" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.509243 20370 raft_consensus.cc:3037] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.509378 20487 tablet_bootstrap.cc:654] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.512547 20410 leader_election.cc:302] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.512465 20370 raft_consensus.cc:2454] T 34fd8e3c3abe4260bfeccff24fbfb20d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.513017 20546 raft_consensus.cc:2781] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.513201 20546 raft_consensus.cc:686] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:30.513559 20546 consensus_queue.cc:237] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.514889 20552 raft_consensus.cc:482] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.515156 20552 raft_consensus.cc:504] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.516052 20552 leader_election.cc:288] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.517607 20486 tablet_bootstrap.cc:492] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.517854 20486 ts_tablet_manager.cc:1367] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.009s
I20240502 14:17:30.518783 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.519228 20293 raft_consensus.cc:2379] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:30.519069 20486 raft_consensus.cc:348] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.519383 20486 raft_consensus.cc:374] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.519477 20486 raft_consensus.cc:729] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.519822 20486 consensus_queue.cc:260] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.520547 20486 ts_tablet_manager.cc:1398] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:30.520476 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c80067ebc4504518a6429c342c100642" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.520696 20487 tablet_bootstrap.cc:492] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.520890 20487 ts_tablet_manager.cc:1367] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20240502 14:17:30.521072 20486 tablet_bootstrap.cc:492] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.521099 20566 raft_consensus.cc:482] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.521251 20566 raft_consensus.cc:504] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.521654 20410 leader_election.cc:302] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.522051 20566 leader_election.cc:288] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.522286 20552 raft_consensus.cc:3037] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.523017 20486 tablet_bootstrap.cc:654] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.526015 20552 raft_consensus.cc:2726] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.526167 20489 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.526397 20489 ts_tablet_manager.cc:1367] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.003s
I20240502 14:17:30.527647 20489 raft_consensus.cc:348] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.527760 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a259e566bef947cba083ea525231254d" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.527954 20489 raft_consensus.cc:374] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.528049 20489 raft_consensus.cc:729] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.528389 20489 consensus_queue.cc:260] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.528894 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a259e566bef947cba083ea525231254d" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.529174 20489 ts_tablet_manager.cc:1398] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20240502 14:17:30.529495 20261 leader_election.cc:341] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.529732 20489 tablet_bootstrap.cc:492] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
W20240502 14:17:30.530071 20261 leader_election.cc:341] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.530226 20261 leader_election.cc:302] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.530793 20566 raft_consensus.cc:2726] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.530692 20487 raft_consensus.cc:348] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.530952 20487 raft_consensus.cc:374] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.531060 20487 raft_consensus.cc:729] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.531348 20487 consensus_queue.cc:260] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.531714 20489 tablet_bootstrap.cc:654] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.532361 20192 catalog_manager.cc:5484] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:30.533448 20487 ts_tablet_manager.cc:1398] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20240502 14:17:30.533810 20487 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.535923 20487 tablet_bootstrap.cc:654] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.536701 20486 tablet_bootstrap.cc:492] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.536875 20486 ts_tablet_manager.cc:1367] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20240502 14:17:30.537844 20486 raft_consensus.cc:348] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.538131 20486 raft_consensus.cc:374] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.538247 20486 raft_consensus.cc:729] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.538504 20486 consensus_queue.cc:260] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.538731 20489 tablet_bootstrap.cc:492] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.539259 20486 ts_tablet_manager.cc:1398] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:17:30.539750 20486 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.541134 20489 ts_tablet_manager.cc:1367] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.006s
I20240502 14:17:30.542165 20489 raft_consensus.cc:348] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.542429 20489 raft_consensus.cc:374] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.542577 20489 raft_consensus.cc:729] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.542892 20486 tablet_bootstrap.cc:654] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.544040 20489 consensus_queue.cc:260] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.547600 20489 ts_tablet_manager.cc:1398] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 14:17:30.548110 20489 tablet_bootstrap.cc:492] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.550305 20489 tablet_bootstrap.cc:654] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.553097 20486 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.553117 20487 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.553440 20486 ts_tablet_manager.cc:1367] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.012s
I20240502 14:17:30.553740 20487 ts_tablet_manager.cc:1367] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.008s
I20240502 14:17:30.553995 20500 consensus_queue.cc:1035] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.554579 20486 raft_consensus.cc:348] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.554849 20486 raft_consensus.cc:374] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.554963 20486 raft_consensus.cc:729] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.555271 20486 consensus_queue.cc:260] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.555477 20487 raft_consensus.cc:348] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.555944 20487 raft_consensus.cc:374] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.556097 20487 raft_consensus.cc:729] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.556304 20486 ts_tablet_manager.cc:1398] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 14:17:30.556645 20487 consensus_queue.cc:260] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.557477 20487 ts_tablet_manager.cc:1398] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:30.558106 20487 tablet_bootstrap.cc:492] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.560635 20487 tablet_bootstrap.cc:654] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.564695 20500 consensus_queue.cc:1035] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.571786 20486 tablet_bootstrap.cc:492] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.573733 20486 tablet_bootstrap.cc:654] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.577786 20512 raft_consensus.cc:482] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.578032 20512 raft_consensus.cc:504] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.578888 20512 leader_election.cc:288] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.579366 20486 tablet_bootstrap.cc:492] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.579604 20486 ts_tablet_manager.cc:1367] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20240502 14:17:30.580613 20486 raft_consensus.cc:348] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.580960 20486 raft_consensus.cc:374] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.581111 20486 raft_consensus.cc:729] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.581482 20486 consensus_queue.cc:260] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.582245 20486 ts_tablet_manager.cc:1398] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:30.582788 20486 tablet_bootstrap.cc:492] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.582190 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0783d83eb7d948a18a5adffb5d6711ea" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.581082 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0783d83eb7d948a18a5adffb5d6711ea" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.583431 20445 raft_consensus.cc:2454] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.585165 20486 tablet_bootstrap.cc:654] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
W20240502 14:17:30.587373 20336 leader_election.cc:341] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.587890 20620 consensus_queue.cc:1035] T 6cce88b36f4e47fdb1f4588104c2917e P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.588754 20336 leader_election.cc:302] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac
I20240502 14:17:30.589107 20620 raft_consensus.cc:2781] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.589202 20620 raft_consensus.cc:482] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.589278 20620 raft_consensus.cc:3037] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.592720 20620 raft_consensus.cc:504] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.593544 20620 leader_election.cc:288] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.593919 20486 tablet_bootstrap.cc:492] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.594156 20486 ts_tablet_manager.cc:1367] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20240502 14:17:30.595142 20486 raft_consensus.cc:348] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.595455 20486 raft_consensus.cc:374] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.595589 20486 raft_consensus.cc:729] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.595939 20486 consensus_queue.cc:260] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.596808 20486 ts_tablet_manager.cc:1398] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:30.597229 20486 tablet_bootstrap.cc:492] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.599268 20486 tablet_bootstrap.cc:654] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.601730 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0783d83eb7d948a18a5adffb5d6711ea" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.602020 20566 raft_consensus.cc:482] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.602226 20566 raft_consensus.cc:504] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.603036 20566 leader_election.cc:288] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.603964 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae70452bab2a4001b7e8b60170cbe230" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:30.604734 20261 leader_election.cc:341] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.603057 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0783d83eb7d948a18a5adffb5d6711ea" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.604952 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae70452bab2a4001b7e8b60170cbe230" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.605139 20445 raft_consensus.cc:3037] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
W20240502 14:17:30.605713 20261 leader_election.cc:341] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.605896 20261 leader_election.cc:302] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.606564 20490 raft_consensus.cc:2726] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.607777 20486 tablet_bootstrap.cc:492] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.608033 20486 ts_tablet_manager.cc:1367] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20240502 14:17:30.608384 20445 raft_consensus.cc:2454] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.609062 20490 consensus_queue.cc:1035] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.609098 20486 raft_consensus.cc:348] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.609535 20486 raft_consensus.cc:374] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.609658 20486 raft_consensus.cc:729] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.609922 20486 consensus_queue.cc:260] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.610878 20336 leader_election.cc:302] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.612358 20620 raft_consensus.cc:2781] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.612534 20620 raft_consensus.cc:686] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.612810 20620 consensus_queue.cc:237] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.615108 20620 consensus_queue.cc:1035] T f6df1c0367904b059bb0c07e74314c74 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 14:17:30.615926 20336 leader_election.cc:341] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.617825 20486 ts_tablet_manager.cc:1398] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20240502 14:17:30.618208 20486 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.621467 20489 tablet_bootstrap.cc:492] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.621685 20489 ts_tablet_manager.cc:1367] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.074s user 0.025s sys 0.029s
I20240502 14:17:30.621747 20486 tablet_bootstrap.cc:654] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.625949 20193 catalog_manager.cc:5484] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.626710 20489 raft_consensus.cc:348] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.633857 20489 raft_consensus.cc:374] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.634083 20489 raft_consensus.cc:729] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.634384 20489 consensus_queue.cc:260] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.635133 20489 ts_tablet_manager.cc:1398] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20240502 14:17:30.635566 20489 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.637530 20489 tablet_bootstrap.cc:654] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.628260 20487 tablet_bootstrap.cc:492] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.639899 20487 ts_tablet_manager.cc:1367] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.082s user 0.032s sys 0.028s
I20240502 14:17:30.632256 20566 consensus_queue.cc:1035] T 20ca5560d70b4ebaa937b4cb2fc4dffe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.640877 20487 raft_consensus.cc:348] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.641121 20487 raft_consensus.cc:374] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.641184 20487 raft_consensus.cc:729] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.641413 20487 consensus_queue.cc:260] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.642064 20487 ts_tablet_manager.cc:1398] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:30.642406 20487 tablet_bootstrap.cc:492] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.644958 20489 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.645186 20489 ts_tablet_manager.cc:1367] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20240502 14:17:30.646162 20489 raft_consensus.cc:348] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.646432 20489 raft_consensus.cc:374] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.646498 20489 raft_consensus.cc:729] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.646783 20489 consensus_queue.cc:260] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.647800 20489 ts_tablet_manager.cc:1398] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:30.650736 20487 tablet_bootstrap.cc:654] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.651310 20489 tablet_bootstrap.cc:492] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.653141 20489 tablet_bootstrap.cc:654] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.657256 20486 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.657442 20486 ts_tablet_manager.cc:1367] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.039s user 0.018s sys 0.010s
I20240502 14:17:30.658283 20486 raft_consensus.cc:348] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.658501 20486 raft_consensus.cc:374] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.658600 20486 raft_consensus.cc:729] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.658809 20486 consensus_queue.cc:260] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.659518 20486 ts_tablet_manager.cc:1398] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.659821 20486 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.661706 20486 tablet_bootstrap.cc:654] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.661939 20620 raft_consensus.cc:482] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.662088 20620 raft_consensus.cc:504] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.662887 20620 leader_election.cc:288] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.663827 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30d3cdb558c479c8431e4a72f073355" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.664064 20444 raft_consensus.cc:2454] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.664712 20336 leader_election.cc:302] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.663792 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30d3cdb558c479c8431e4a72f073355" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.665169 20296 raft_consensus.cc:2454] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.665336 20512 raft_consensus.cc:2781] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.665414 20512 raft_consensus.cc:482] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.665483 20512 raft_consensus.cc:3037] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.664947 20620 raft_consensus.cc:482] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.666111 20620 raft_consensus.cc:504] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.666908 20620 leader_election.cc:288] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.668170 20512 raft_consensus.cc:504] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.668354 20487 tablet_bootstrap.cc:492] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.668526 20487 ts_tablet_manager.cc:1367] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.005s
I20240502 14:17:30.668675 20512 leader_election.cc:288] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.669777 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ebb8c62fbd49dea69b8f289df1bf60" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.669777 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ebb8c62fbd49dea69b8f289df1bf60" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.669874 20487 raft_consensus.cc:348] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.670100 20487 raft_consensus.cc:374] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.670151 20487 raft_consensus.cc:729] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.670465 20487 consensus_queue.cc:260] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.670784 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30d3cdb558c479c8431e4a72f073355" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.670972 20296 raft_consensus.cc:3037] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.671252 20487 ts_tablet_manager.cc:1398] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20240502 14:17:30.671509 20336 leader_election.cc:341] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:30.671855 20336 leader_election.cc:341] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.671957 20336 leader_election.cc:302] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.672904 20487 tablet_bootstrap.cc:492] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.674144 20296 raft_consensus.cc:2454] T f30d3cdb558c479c8431e4a72f073355 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.670791 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f30d3cdb558c479c8431e4a72f073355" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.675005 20444 raft_consensus.cc:3037] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.675161 20487 tablet_bootstrap.cc:654] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.675304 20489 tablet_bootstrap.cc:492] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.675465 20489 ts_tablet_manager.cc:1367] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.009s
I20240502 14:17:30.676339 20489 raft_consensus.cc:348] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.676580 20489 raft_consensus.cc:374] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.676642 20489 raft_consensus.cc:729] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.676890 20489 consensus_queue.cc:260] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.677337 20486 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.677496 20486 ts_tablet_manager.cc:1367] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20240502 14:17:30.678345 20486 raft_consensus.cc:348] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.678614 20486 raft_consensus.cc:374] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.678671 20486 raft_consensus.cc:729] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.678720 20336 leader_election.cc:302] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.678889 20486 consensus_queue.cc:260] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.679208 20500 raft_consensus.cc:2726] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.679351 20500 raft_consensus.cc:2781] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.679407 20489 ts_tablet_manager.cc:1398] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 14:17:30.679445 20500 raft_consensus.cc:686] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.679747 20489 tablet_bootstrap.cc:492] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.679698 20500 consensus_queue.cc:237] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.681771 20489 tablet_bootstrap.cc:654] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.685026 20546 raft_consensus.cc:482] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.685218 20546 raft_consensus.cc:504] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.686045 20546 leader_election.cc:288] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.686136 20486 ts_tablet_manager.cc:1398] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20240502 14:17:30.686851 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39035e415e624aefadb9022d67a91419" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.687083 20370 raft_consensus.cc:2454] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.686851 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39035e415e624aefadb9022d67a91419" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.687445 20293 raft_consensus.cc:2454] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.687474 20486 tablet_bootstrap.cc:492] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.688128 20410 leader_election.cc:302] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.688975 20546 raft_consensus.cc:2781] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.689054 20546 raft_consensus.cc:482] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.689116 20546 raft_consensus.cc:3037] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.689213 20444 raft_consensus.cc:2454] T f30d3cdb558c479c8431e4a72f073355 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.693542 20486 tablet_bootstrap.cc:654] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.694231 20546 raft_consensus.cc:504] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.694350 20487 tablet_bootstrap.cc:492] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.694628 20487 ts_tablet_manager.cc:1367] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.004s
I20240502 14:17:30.694981 20490 raft_consensus.cc:482] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.695138 20490 raft_consensus.cc:504] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.695396 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39035e415e624aefadb9022d67a91419" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.695564 20296 raft_consensus.cc:3037] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.695760 20490 leader_election.cc:288] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.696038 20487 raft_consensus.cc:348] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.696511 20487 raft_consensus.cc:374] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.696594 20487 raft_consensus.cc:729] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.696588 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0daf493925c48a68592d5ac37c56146" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.696913 20444 raft_consensus.cc:2454] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.696955 20487 consensus_queue.cc:260] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.697319 20261 leader_election.cc:302] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.697631 20490 raft_consensus.cc:2781] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.697710 20490 raft_consensus.cc:482] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.697782 20490 raft_consensus.cc:3037] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.698494 20296 raft_consensus.cc:2454] T 39035e415e624aefadb9022d67a91419 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.698868 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0daf493925c48a68592d5ac37c56146" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.699048 20370 raft_consensus.cc:2454] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.698746 20193 catalog_manager.cc:5484] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.699976 20410 leader_election.cc:302] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.700346 20552 raft_consensus.cc:2781] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.700503 20552 raft_consensus.cc:686] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:30.700812 20552 consensus_queue.cc:237] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.701843 20486 tablet_bootstrap.cc:492] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.702013 20486 ts_tablet_manager.cc:1367] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.000s
I20240502 14:17:30.702227 20490 raft_consensus.cc:504] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.702811 20486 raft_consensus.cc:348] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.702952 20490 leader_election.cc:288] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.703007 20486 raft_consensus.cc:374] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.703081 20486 raft_consensus.cc:729] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.703284 20486 consensus_queue.cc:260] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.703955 20486 ts_tablet_manager.cc:1398] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.704279 20486 tablet_bootstrap.cc:492] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.704491 20569 raft_consensus.cc:482] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.704715 20569 raft_consensus.cc:504] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.705703 20487 ts_tablet_manager.cc:1398] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20240502 14:17:30.706058 20487 tablet_bootstrap.cc:492] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.706223 20486 tablet_bootstrap.cc:654] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.706265 20569 leader_election.cc:288] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.706712 20496 raft_consensus.cc:482] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.706916 20496 raft_consensus.cc:504] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.707715 20496 leader_election.cc:288] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.707969 20487 tablet_bootstrap.cc:654] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.709148 20489 tablet_bootstrap.cc:492] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.709194 20486 tablet_bootstrap.cc:492] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.709444 20486 ts_tablet_manager.cc:1367] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.003s
I20240502 14:17:30.709463 20489 ts_tablet_manager.cc:1367] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.001s
I20240502 14:17:30.710076 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.710178 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0daf493925c48a68592d5ac37c56146" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.710309 20444 raft_consensus.cc:3037] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.710659 20486 raft_consensus.cc:348] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.710886 20486 raft_consensus.cc:374] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.710939 20486 raft_consensus.cc:729] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.711040 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0daf493925c48a68592d5ac37c56146" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.711210 20371 raft_consensus.cc:3037] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.711197 20486 consensus_queue.cc:260] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.711841 20486 ts_tablet_manager.cc:1398] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.711967 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.712203 20486 tablet_bootstrap.cc:492] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
W20240502 14:17:30.713003 20261 leader_election.cc:341] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:30.713265 20261 leader_election.cc:341] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.713358 20261 leader_election.cc:302] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.714329 20486 tablet_bootstrap.cc:654] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.714392 20371 raft_consensus.cc:2454] T e0daf493925c48a68592d5ac37c56146 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.715308 20569 raft_consensus.cc:2726] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.717180 20487 tablet_bootstrap.cc:492] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.717398 20487 ts_tablet_manager.cc:1367] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240502 14:17:30.717423 20444 raft_consensus.cc:2454] T e0daf493925c48a68592d5ac37c56146 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.717880 20261 leader_election.cc:302] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.718408 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.718930 20489 raft_consensus.cc:348] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.719215 20489 raft_consensus.cc:374] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.719332 20489 raft_consensus.cc:729] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.719749 20569 raft_consensus.cc:2781] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.719863 20569 raft_consensus.cc:686] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:30.719875 20487 raft_consensus.cc:348] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.720083 20487 raft_consensus.cc:374] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.720134 20487 raft_consensus.cc:729] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.720127 20569 consensus_queue.cc:237] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.720428 20487 consensus_queue.cc:260] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.721239 20487 ts_tablet_manager.cc:1398] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240502 14:17:30.721580 20487 tablet_bootstrap.cc:492] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.723173 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449e6e4e1a274922aa9bf52b2ce7d025" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.723446 20296 raft_consensus.cc:2379] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:30.723809 20487 tablet_bootstrap.cc:654] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.727818 20546 leader_election.cc:288] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.729809 20489 consensus_queue.cc:260] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.731325 20489 ts_tablet_manager.cc:1398] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.022s user 0.000s sys 0.002s
I20240502 14:17:30.736647 20489 tablet_bootstrap.cc:492] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.741518 20489 tablet_bootstrap.cc:654] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.746031 20496 raft_consensus.cc:482] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.746240 20496 raft_consensus.cc:504] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.747066 20496 leader_election.cc:288] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.751024 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39035e415e624aefadb9022d67a91419" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.751674 20371 raft_consensus.cc:3037] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.753661 20490 raft_consensus.cc:482] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.753818 20490 raft_consensus.cc:504] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.754487 20490 leader_election.cc:288] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.755249 20371 raft_consensus.cc:2454] T 39035e415e624aefadb9022d67a91419 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.755396 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05eba15f48eb4ff4b1b87d7f36b186a5" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:30.755905 20261 leader_election.cc:341] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.756148 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05eba15f48eb4ff4b1b87d7f36b186a5" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.756322 20444 raft_consensus.cc:2454] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.756692 20261 leader_election.cc:302] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.757036 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf758a9a8314106bcb1ed7abb8cc220" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.757119 20490 raft_consensus.cc:2781] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.757248 20490 raft_consensus.cc:482] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.757350 20490 raft_consensus.cc:3037] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.758770 20296 raft_consensus.cc:2454] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.759389 20486 tablet_bootstrap.cc:492] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.759550 20486 ts_tablet_manager.cc:1367] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.031s
I20240502 14:17:30.759776 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf758a9a8314106bcb1ed7abb8cc220" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.760025 20371 raft_consensus.cc:2454] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.760102 20490 raft_consensus.cc:504] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.760382 20486 raft_consensus.cc:348] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.760563 20486 raft_consensus.cc:374] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.760617 20486 raft_consensus.cc:729] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.760815 20486 consensus_queue.cc:260] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.761457 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05eba15f48eb4ff4b1b87d7f36b186a5" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.761540 20486 ts_tablet_manager.cc:1398] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.761703 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05eba15f48eb4ff4b1b87d7f36b186a5" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.761866 20444 raft_consensus.cc:3037] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.761977 20486 tablet_bootstrap.cc:492] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
W20240502 14:17:30.762238 20261 leader_election.cc:341] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.763599 20552 raft_consensus.cc:482] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.763855 20486 tablet_bootstrap.cc:654] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.763754 20552 raft_consensus.cc:504] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.764425 20552 leader_election.cc:288] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.765133 20410 leader_election.cc:302] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.765477 20552 raft_consensus.cc:3037] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.769162 20552 raft_consensus.cc:2726] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.764926 20444 raft_consensus.cc:2454] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.769989 20410 leader_election.cc:302] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:30.770148 20261 leader_election.cc:302] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.770440 20552 raft_consensus.cc:2781] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.770612 20552 raft_consensus.cc:482] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.770771 20552 raft_consensus.cc:3037] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.770489 20566 raft_consensus.cc:2781] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.770962 20566 raft_consensus.cc:686] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:30.771328 20566 consensus_queue.cc:237] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.772755 20486 tablet_bootstrap.cc:492] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.772713 20500 raft_consensus.cc:482] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.772923 20486 ts_tablet_manager.cc:1367] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240502 14:17:30.772905 20500 raft_consensus.cc:504] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.773583 20500 leader_election.cc:288] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.773754 20486 raft_consensus.cc:348] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.773932 20486 raft_consensus.cc:374] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.774003 20486 raft_consensus.cc:729] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.770938 20490 leader_election.cc:288] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.774201 20486 consensus_queue.cc:260] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.774631 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "984c1d6e64e84bcdb9f5644b8d8a3565" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.774791 20486 ts_tablet_manager.cc:1398] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.774974 20296 raft_consensus.cc:2454] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.775151 20486 tablet_bootstrap.cc:492] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.775513 20336 leader_election.cc:302] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.776113 20500 raft_consensus.cc:2781] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.776202 20500 raft_consensus.cc:482] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.776268 20500 raft_consensus.cc:3037] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.776969 20486 tablet_bootstrap.cc:654] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.779752 20500 raft_consensus.cc:504] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.780633 20500 leader_election.cc:288] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.781994 20552 raft_consensus.cc:504] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.783133 20552 leader_election.cc:288] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.782092 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "984c1d6e64e84bcdb9f5644b8d8a3565" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.783488 20296 raft_consensus.cc:3037] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.787361 20296 raft_consensus.cc:2454] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.788431 20552 consensus_queue.cc:1035] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.788471 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f956dfc843814ccd92546e00110c79ca" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.789474 20336 leader_election.cc:302] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.789534 20566 raft_consensus.cc:482] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.789772 20566 raft_consensus.cc:504] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.789961 20620 raft_consensus.cc:2781] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.790097 20620 raft_consensus.cc:686] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.790454 20566 leader_election.cc:288] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.790372 20620 consensus_queue.cc:237] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.791541 20512 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.791625 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a741834267475b957eb3203e8e0563" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.791851 20370 raft_consensus.cc:2454] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.792580 20261 leader_election.cc:302] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.793615 20510 raft_consensus.cc:2781] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.793709 20510 raft_consensus.cc:482] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.789481 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f956dfc843814ccd92546e00110c79ca" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.793833 20510 raft_consensus.cc:3037] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.793962 20371 raft_consensus.cc:2379] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
I20240502 14:17:30.794620 20500 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.795835 20489 tablet_bootstrap.cc:492] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.795953 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf758a9a8314106bcb1ed7abb8cc220" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.796046 20489 ts_tablet_manager.cc:1367] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.003s
I20240502 14:17:30.796159 20371 raft_consensus.cc:3037] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.796991 20489 raft_consensus.cc:348] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.797260 20489 raft_consensus.cc:374] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.797354 20489 raft_consensus.cc:729] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.797405 20510 raft_consensus.cc:504] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.797735 20489 consensus_queue.cc:260] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.798367 20489 ts_tablet_manager.cc:1398] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:30.798751 20489 tablet_bootstrap.cc:492] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.799111 20371 raft_consensus.cc:2454] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.800314 20410 leader_election.cc:302] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.800799 20489 tablet_bootstrap.cc:654] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.800968 20552 raft_consensus.cc:2781] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.801260 20552 raft_consensus.cc:686] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:30.801560 20552 consensus_queue.cc:237] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.802393 20192 catalog_manager.cc:5484] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.802999 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "984c1d6e64e84bcdb9f5644b8d8a3565" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.803284 20445 raft_consensus.cc:2454] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.803804 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "984c1d6e64e84bcdb9f5644b8d8a3565" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.804030 20445 raft_consensus.cc:3037] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.807621 20445 raft_consensus.cc:2454] T 984c1d6e64e84bcdb9f5644b8d8a3565 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.810739 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a741834267475b957eb3203e8e0563" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.811216 20444 raft_consensus.cc:2454] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:30.812618 20510 leader_election.cc:288] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.813875 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a741834267475b957eb3203e8e0563" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:30.820308 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a741834267475b957eb3203e8e0563" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.818001 20500 raft_consensus.cc:482] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.821936 20620 raft_consensus.cc:482] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.822134 20620 raft_consensus.cc:504] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.823248 20620 leader_election.cc:288] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.823609 20370 raft_consensus.cc:3037] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.824586 20410 leader_election.cc:302] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.826094 20496 raft_consensus.cc:3037] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.827970 20370 raft_consensus.cc:2454] T 14a741834267475b957eb3203e8e0563 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.829263 20496 raft_consensus.cc:2726] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.829311 20620 raft_consensus.cc:482] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.829520 20620 raft_consensus.cc:504] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.830296 20620 leader_election.cc:288] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.831660 20444 raft_consensus.cc:3037] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.831573 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877ddfafada342978bfce99e7190f253" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.831599 20261 leader_election.cc:302] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:30.834177 20336 leader_election.cc:341] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.834738 20510 raft_consensus.cc:2781] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.834949 20510 raft_consensus.cc:686] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:30.835372 20510 consensus_queue.cc:237] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.836913 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877ddfafada342978bfce99e7190f253" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.836935 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.841603 20620 raft_consensus.cc:482] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.841826 20620 raft_consensus.cc:504] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:30.842772 20336 leader_election.cc:341] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.842967 20336 leader_election.cc:302] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.843271 20512 raft_consensus.cc:2726] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.843461 20620 leader_election.cc:288] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.844554 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a259e566bef947cba083ea525231254d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.844871 20295 raft_consensus.cc:2454] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.845839 20336 leader_election.cc:302] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:30.846874 20336 leader_election.cc:341] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.847013 20620 raft_consensus.cc:2781] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.847179 20620 raft_consensus.cc:482] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.847291 20620 raft_consensus.cc:3037] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.849745 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a259e566bef947cba083ea525231254d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.850055 20445 raft_consensus.cc:2454] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.850903 20552 consensus_queue.cc:1035] T a677e91ff17845bda5bce77bf3d5de22 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.838361 20193 catalog_manager.cc:5484] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:30.839151 20195 catalog_manager.cc:5484] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.839546 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.839702 20500 raft_consensus.cc:504] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.854343 20500 leader_election.cc:288] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
W20240502 14:17:30.856695 20336 leader_election.cc:341] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.857899 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501adddb143b4c03bdf4b0e6476baeac" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.860937 20336 leader_election.cc:302] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.861796 20494 raft_consensus.cc:2726] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.862579 20487 tablet_bootstrap.cc:492] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
W20240502 14:17:30.862474 20336 leader_election.cc:341] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.862793 20487 ts_tablet_manager.cc:1367] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.141s user 0.041s sys 0.050s
I20240502 14:17:30.863381 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501adddb143b4c03bdf4b0e6476baeac" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.863822 20487 raft_consensus.cc:348] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.864082 20487 raft_consensus.cc:374] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.864216 20487 raft_consensus.cc:729] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.864509 20487 consensus_queue.cc:260] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:30.864828 20336 leader_election.cc:341] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.864995 20336 leader_election.cc:302] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.865182 20487 ts_tablet_manager.cc:1398] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 14:17:30.865386 20486 tablet_bootstrap.cc:492] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:30.865500 20500 raft_consensus.cc:2726] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:30.865553 20487 tablet_bootstrap.cc:492] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.865803 20486 ts_tablet_manager.cc:1367] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.091s user 0.037s sys 0.051s
I20240502 14:17:30.866828 20486 raft_consensus.cc:348] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.867199 20486 raft_consensus.cc:374] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.867355 20486 raft_consensus.cc:729] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.867771 20487 tablet_bootstrap.cc:654] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.867734 20486 consensus_queue.cc:260] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.868592 20486 ts_tablet_manager.cc:1398] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:30.869019 20486 tablet_bootstrap.cc:492] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:30.869323 20494 raft_consensus.cc:482] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.869524 20489 tablet_bootstrap.cc:492] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.869518 20494 raft_consensus.cc:504] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.869733 20489 ts_tablet_manager.cc:1367] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.017s
I20240502 14:17:30.870358 20494 leader_election.cc:288] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.870676 20489 raft_consensus.cc:348] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.870913 20489 raft_consensus.cc:374] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.871027 20489 raft_consensus.cc:729] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.871336 20489 consensus_queue.cc:260] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.871737 20486 tablet_bootstrap.cc:654] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.872141 20489 ts_tablet_manager.cc:1398] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:30.872509 20489 tablet_bootstrap.cc:492] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.874513 20489 tablet_bootstrap.cc:654] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.876046 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88bd39a1f614d9987a0f306980b19d7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.876667 20487 tablet_bootstrap.cc:492] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.876873 20487 ts_tablet_manager.cc:1367] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20240502 14:17:30.877768 20487 raft_consensus.cc:348] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.878087 20487 raft_consensus.cc:374] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.878185 20487 raft_consensus.cc:729] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.878484 20487 consensus_queue.cc:260] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.879317 20487 ts_tablet_manager.cc:1398] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:17:30.879724 20487 tablet_bootstrap.cc:492] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.880657 20192 catalog_manager.cc:5484] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:30.881266 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88bd39a1f614d9987a0f306980b19d7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.881562 20294 raft_consensus.cc:2454] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.884727 20487 tablet_bootstrap.cc:654] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.885772 20336 leader_election.cc:302] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.887360 20489 tablet_bootstrap.cc:492] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.887603 20489 ts_tablet_manager.cc:1367] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20240502 14:17:30.887492 20620 raft_consensus.cc:504] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.888490 20620 leader_election.cc:288] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.888587 20489 raft_consensus.cc:348] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.888865 20489 raft_consensus.cc:374] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.888981 20489 raft_consensus.cc:729] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.889358 20489 consensus_queue.cc:260] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.890216 20489 ts_tablet_manager.cc:1398] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240502 14:17:30.890166 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "daf758a9a8314106bcb1ed7abb8cc220" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.890463 20296 raft_consensus.cc:3037] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.890802 20489 tablet_bootstrap.cc:492] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.893141 20489 tablet_bootstrap.cc:654] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.894359 20296 raft_consensus.cc:2454] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:30.895650 20494 raft_consensus.cc:2781] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.895828 20494 raft_consensus.cc:482] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.895859 20487 tablet_bootstrap.cc:492] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.895942 20494 raft_consensus.cc:3037] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.896066 20487 ts_tablet_manager.cc:1367] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20240502 14:17:30.897137 20487 raft_consensus.cc:348] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.897521 20487 raft_consensus.cc:374] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.897653 20487 raft_consensus.cc:729] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.898043 20487 consensus_queue.cc:260] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.898902 20487 ts_tablet_manager.cc:1398] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:30.899309 20487 tablet_bootstrap.cc:492] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.900559 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a259e566bef947cba083ea525231254d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.900810 20443 raft_consensus.cc:3037] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.900730 20494 raft_consensus.cc:504] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.901585 20494 leader_election.cc:288] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.901742 20487 tablet_bootstrap.cc:654] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.904372 20443 raft_consensus.cc:2454] T a259e566bef947cba083ea525231254d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.904525 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a259e566bef947cba083ea525231254d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.904788 20294 raft_consensus.cc:3037] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.907078 20490 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.859876 20444 raft_consensus.cc:2454] T 14a741834267475b957eb3203e8e0563 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:30.908663 20294 raft_consensus.cc:2454] T a259e566bef947cba083ea525231254d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.910507 20489 tablet_bootstrap.cc:492] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:30.910815 20489 ts_tablet_manager.cc:1367] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20240502 14:17:30.912003 20489 raft_consensus.cc:348] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.912319 20489 raft_consensus.cc:374] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.912426 20489 raft_consensus.cc:729] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.912808 20489 consensus_queue.cc:260] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.913648 20489 ts_tablet_manager.cc:1398] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:30.914084 20489 tablet_bootstrap.cc:492] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:30.919642 20489 tablet_bootstrap.cc:654] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.922572 20487 tablet_bootstrap.cc:492] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.922870 20487 ts_tablet_manager.cc:1367] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.002s
W20240502 14:17:30.922781 20336 leader_election.cc:341] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.924455 20336 leader_election.cc:302] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:30.924968 20512 raft_consensus.cc:482] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.925185 20512 raft_consensus.cc:504] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.925333 20494 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.925376 20500 raft_consensus.cc:2781] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.925921 20512 leader_election.cc:288] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.925817 20500 raft_consensus.cc:686] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.925804 20487 raft_consensus.cc:348] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.926127 20487 raft_consensus.cc:374] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:30.926230 20487 raft_consensus.cc:729] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:30.926373 20512 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.926483 20487 consensus_queue.cc:260] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.927277 20487 ts_tablet_manager.cc:1398] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:30.927397 20500 consensus_queue.cc:237] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.927685 20487 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:30.928567 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88bd39a1f614d9987a0f306980b19d7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:30.932714 20487 tablet_bootstrap.cc:654] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:30.937536 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88bd39a1f614d9987a0f306980b19d7" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.937951 20294 raft_consensus.cc:3037] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.940222 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "079e05082c0c4434a4dcabafa01bfba9" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.942052 20294 raft_consensus.cc:2454] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:30.942564 20569 raft_consensus.cc:482] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240502 14:17:30.942891 20336 leader_election.cc:341] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.942828 20569 raft_consensus.cc:504] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:30.943210 20336 leader_election.cc:341] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.943476 20620 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.943769 20569 leader_election.cc:288] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:30.948093 20336 leader_election.cc:302] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:30.952021 20620 raft_consensus.cc:2781] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:30.952394 20620 raft_consensus.cc:686] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:30.952782 20620 consensus_queue.cc:237] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.962294 20445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b09e67785d84964a32c0c7f61d05516" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:30.962294 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b09e67785d84964a32c0c7f61d05516" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:30.966042 20261 leader_election.cc:341] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:30.966995 20261 leader_election.cc:341] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.967180 20261 leader_election.cc:302] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:30.969087 20487 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:30.969305 20487 ts_tablet_manager.cc:1367] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.042s user 0.024s sys 0.002s
I20240502 14:17:30.968176 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "079e05082c0c4434a4dcabafa01bfba9" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.969769 20293 raft_consensus.cc:2454] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:30.973348 20703 raft_consensus.cc:482] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:30.973547 20703 raft_consensus.cc:504] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.974375 20703 leader_election.cc:288] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:30.975498 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:30.975777 20294 raft_consensus.cc:2454] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:30.976487 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:30.976656 20707 consensus_queue.cc:1035] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.976487 20410 leader_election.cc:302] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
W20240502 14:17:30.977520 20410 leader_election.cc:341] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:30.979113 20707 raft_consensus.cc:2781] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:30.981690 20707 raft_consensus.cc:482] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:30.981842 20707 raft_consensus.cc:3037] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:30.983937 20496 consensus_queue.cc:1035] T 34fd8e3c3abe4260bfeccff24fbfb20d P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:30.985280 20195 catalog_manager.cc:5484] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.986363 20195 catalog_manager.cc:5484] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:30.995059 20707 raft_consensus.cc:504] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:30.996803 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:30.997220 20293 raft_consensus.cc:3037] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.004376 20569 raft_consensus.cc:2726] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.005167 20487 raft_consensus.cc:348] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.005489 20487 raft_consensus.cc:374] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.005595 20487 raft_consensus.cc:729] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.007330 20490 raft_consensus.cc:482] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.007517 20490 raft_consensus.cc:504] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.008316 20490 leader_election.cc:288] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.008611 20487 consensus_queue.cc:260] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.008703 20703 raft_consensus.cc:482] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.008971 20703 raft_consensus.cc:504] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.009539 20487 ts_tablet_manager.cc:1398] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.040s user 0.002s sys 0.002s
I20240502 14:17:31.009773 20703 leader_election.cc:288] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.009949 20487 tablet_bootstrap.cc:492] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.010612 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ebb8c62fbd49dea69b8f289df1bf60" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.010911 20294 raft_consensus.cc:2454] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.011965 20410 leader_election.cc:302] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.012400 20487 tablet_bootstrap.cc:654] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.012639 20496 raft_consensus.cc:2781] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.012818 20496 raft_consensus.cc:482] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.012943 20496 raft_consensus.cc:3037] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.016558 20496 raft_consensus.cc:504] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.017340 20496 leader_election.cc:288] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
W20240502 14:17:31.014340 20261 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.176.3:42527, user_credentials={real_user=slave}} blocked reactor thread for 47331.1us
I20240502 14:17:31.018402 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ebb8c62fbd49dea69b8f289df1bf60" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.018672 20294 raft_consensus.cc:3037] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.018956 20500 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.022042 20294 raft_consensus.cc:2454] T e4ebb8c62fbd49dea69b8f289df1bf60 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.023480 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ebb8c62fbd49dea69b8f289df1bf60" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.023746 20370 raft_consensus.cc:3037] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.024813 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ebb8c62fbd49dea69b8f289df1bf60" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.023710 20410 leader_election.cc:302] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.026214 20704 raft_consensus.cc:2781] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.026430 20704 raft_consensus.cc:686] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.026727 20704 consensus_queue.cc:237] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.031093 20192 catalog_manager.cc:5484] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.031809 20370 raft_consensus.cc:2454] T e4ebb8c62fbd49dea69b8f289df1bf60 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.031831 20293 raft_consensus.cc:2454] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.033571 20410 leader_election.cc:302] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.034659 20496 raft_consensus.cc:2781] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.034816 20496 raft_consensus.cc:686] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.035121 20496 consensus_queue.cc:237] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.036590 20336 leader_election.cc:302] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
W20240502 14:17:31.036759 20243 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:17:31.037178 20620 raft_consensus.cc:2781] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.037302 20620 raft_consensus.cc:482] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.037393 20620 raft_consensus.cc:3037] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.038841 20703 raft_consensus.cc:482] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.038995 20703 raft_consensus.cc:504] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.039726 20703 leader_election.cc:288] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.040549 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501adddb143b4c03bdf4b0e6476baeac" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.040786 20294 raft_consensus.cc:2454] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.040895 20620 raft_consensus.cc:504] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.041375 20410 leader_election.cc:302] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.041452 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501adddb143b4c03bdf4b0e6476baeac" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.041666 20496 raft_consensus.cc:2781] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.041781 20620 leader_election.cc:288] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.041858 20496 raft_consensus.cc:482] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.042078 20496 raft_consensus.cc:3037] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.041791 20370 raft_consensus.cc:2454] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.042450 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.043543 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0783d83eb7d948a18a5adffb5d6711ea" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:31.044260 20410 leader_election.cc:341] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.041980 20707 leader_election.cc:288] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.044395 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0783d83eb7d948a18a5adffb5d6711ea" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.044831 20444 raft_consensus.cc:2379] T 0783d83eb7d948a18a5adffb5d6711ea P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14e6d73ccbc9463cbc192df0e4d125ac in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:31.044759 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "079e05082c0c4434a4dcabafa01bfba9" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
W20240502 14:17:31.045212 20336 leader_election.cc:341] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.047137 20496 raft_consensus.cc:504] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.047492 20510 raft_consensus.cc:482] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.047828 20510 raft_consensus.cc:504] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.048178 20620 raft_consensus.cc:482] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.048303 20620 raft_consensus.cc:504] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.048766 20510 leader_election.cc:288] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.048785 20620 leader_election.cc:288] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.050357 20496 leader_election.cc:288] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.050673 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501adddb143b4c03bdf4b0e6476baeac" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.051355 20293 raft_consensus.cc:3037] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.051431 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae70452bab2a4001b7e8b60170cbe230" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.051707 20444 raft_consensus.cc:2454] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:31.053793 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "079e05082c0c4434a4dcabafa01bfba9" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.054049 20297 raft_consensus.cc:3037] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.054334 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae70452bab2a4001b7e8b60170cbe230" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.054656 20295 raft_consensus.cc:2454] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:31.059639 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ad302fb34c4af592576654060e05c8" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.059899 20370 raft_consensus.cc:2454] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.060348 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ad302fb34c4af592576654060e05c8" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.061707 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "501adddb143b4c03bdf4b0e6476baeac" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.062707 20372 raft_consensus.cc:3037] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.067910 20510 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.071125 20487 tablet_bootstrap.cc:492] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.071461 20487 ts_tablet_manager.cc:1367] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.002s
I20240502 14:17:31.073076 20297 raft_consensus.cc:2454] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.074450 20372 raft_consensus.cc:2454] T 501adddb143b4c03bdf4b0e6476baeac P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.074939 20410 leader_election.cc:302] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.075001 20261 leader_election.cc:302] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.075345 20489 tablet_bootstrap.cc:492] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.075511 20489 ts_tablet_manager.cc:1367] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.162s user 0.034s sys 0.026s
I20240502 14:17:31.076051 20510 raft_consensus.cc:3037] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.076356 20489 raft_consensus.cc:348] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.076575 20489 raft_consensus.cc:374] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.076632 20489 raft_consensus.cc:729] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.076876 20489 consensus_queue.cc:260] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.079797 20496 raft_consensus.cc:2781] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.079955 20496 raft_consensus.cc:686] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.081660 20496 consensus_queue.cc:237] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.083339 20510 raft_consensus.cc:2726] T 0783d83eb7d948a18a5adffb5d6711ea P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 14:17:31.083496 20261 leader_election.cc:341] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.084878 20707 raft_consensus.cc:482] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.086508 20293 raft_consensus.cc:2454] T 501adddb143b4c03bdf4b0e6476baeac P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.087759 20489 ts_tablet_manager.cc:1398] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20240502 14:17:31.088116 20489 tablet_bootstrap.cc:492] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.085292 20487 raft_consensus.cc:348] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.088677 20487 raft_consensus.cc:374] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.088743 20487 raft_consensus.cc:729] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.089037 20487 consensus_queue.cc:260] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.089535 20261 leader_election.cc:302] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.089879 20510 raft_consensus.cc:2781] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.090034 20510 raft_consensus.cc:482] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.090178 20510 raft_consensus.cc:3037] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.085033 20707 raft_consensus.cc:504] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.091557 20486 tablet_bootstrap.cc:492] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.091794 20486 ts_tablet_manager.cc:1367] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.223s user 0.065s sys 0.120s
I20240502 14:17:31.096457 20707 leader_election.cc:288] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.098038 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88bd39a1f614d9987a0f306980b19d7" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.099498 20566 consensus_queue.cc:1035] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.100797 20487 ts_tablet_manager.cc:1398] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20240502 14:17:31.100876 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88bd39a1f614d9987a0f306980b19d7" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.101117 20293 raft_consensus.cc:2379] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:31.101291 20487 tablet_bootstrap.cc:492] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.101577 20410 leader_election.cc:302] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.102246 20704 raft_consensus.cc:3037] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.107021 20489 tablet_bootstrap.cc:654] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.109769 20486 raft_consensus.cc:348] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.110116 20486 raft_consensus.cc:374] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.110188 20486 raft_consensus.cc:729] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.110780 20486 consensus_queue.cc:260] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.111764 20486 ts_tablet_manager.cc:1398] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20240502 14:17:31.112305 20486 tablet_bootstrap.cc:492] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.116344 20510 raft_consensus.cc:504] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.117247 20487 tablet_bootstrap.cc:654] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.119515 20510 leader_election.cc:288] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.120254 20192 catalog_manager.cc:5484] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
W20240502 14:17:31.119251 20336 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.176.1:46599, user_credentials={real_user=slave}} blocked reactor thread for 58426.3us
I20240502 14:17:31.121279 20336 leader_election.cc:302] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.121729 20620 raft_consensus.cc:2781] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.121841 20620 raft_consensus.cc:482] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.121920 20620 raft_consensus.cc:3037] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.123250 20336 leader_election.cc:302] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.123615 20500 raft_consensus.cc:2781] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.123813 20500 raft_consensus.cc:686] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:31.124188 20500 consensus_queue.cc:237] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.126515 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ad302fb34c4af592576654060e05c8" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.126803 20371 raft_consensus.cc:3037] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.128007 20486 tablet_bootstrap.cc:654] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.128428 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17ad302fb34c4af592576654060e05c8" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
W20240502 14:17:31.131501 20261 leader_election.cc:341] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.142392 20707 consensus_queue.cc:1035] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.149578 20704 raft_consensus.cc:2726] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.151835 20740 consensus_queue.cc:1035] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20240502 14:17:31.159937 20489 tablet_bootstrap.cc:492] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.160167 20489 ts_tablet_manager.cc:1367] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.072s user 0.014s sys 0.002s
I20240502 14:17:31.162364 20620 raft_consensus.cc:504] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.163367 20620 leader_election.cc:288] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.163930 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae70452bab2a4001b7e8b60170cbe230" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.164177 20293 raft_consensus.cc:3037] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.166266 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae70452bab2a4001b7e8b60170cbe230" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.166559 20442 raft_consensus.cc:3037] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.171352 20293 raft_consensus.cc:2454] T ae70452bab2a4001b7e8b60170cbe230 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.172034 20336 leader_election.cc:302] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.172405 20740 raft_consensus.cc:2781] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.172582 20740 raft_consensus.cc:686] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:31.172919 20740 consensus_queue.cc:237] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.176208 20442 raft_consensus.cc:2454] T ae70452bab2a4001b7e8b60170cbe230 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.182859 20371 raft_consensus.cc:2454] T 17ad302fb34c4af592576654060e05c8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.184271 20261 leader_election.cc:302] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.184695 20566 raft_consensus.cc:2781] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.184816 20566 raft_consensus.cc:686] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.185083 20566 consensus_queue.cc:237] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.186368 20569 consensus_queue.cc:1035] T e0daf493925c48a68592d5ac37c56146 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20240502 14:17:31.189556 20569 raft_consensus.cc:482] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.189741 20569 raft_consensus.cc:504] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.190783 20569 leader_election.cc:288] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.191395 20195 catalog_manager.cc:5484] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.191838 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d9972f6b3e44328639f1d4636b5f15" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:31.192775 20261 leader_election.cc:341] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.189718 20487 tablet_bootstrap.cc:492] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.193332 20487 ts_tablet_manager.cc:1367] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.092s user 0.004s sys 0.022s
I20240502 14:17:31.193364 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d9972f6b3e44328639f1d4636b5f15" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:31.194254 20261 leader_election.cc:341] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.194392 20261 leader_election.cc:302] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.194959 20569 raft_consensus.cc:2726] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.194948 20489 raft_consensus.cc:348] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.195202 20489 raft_consensus.cc:374] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.195277 20489 raft_consensus.cc:729] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.195508 20489 consensus_queue.cc:260] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.196064 20489 ts_tablet_manager.cc:1398] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.036s user 0.001s sys 0.000s
I20240502 14:17:31.196851 20487 raft_consensus.cc:348] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.197074 20487 raft_consensus.cc:374] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.197149 20487 raft_consensus.cc:729] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.197324 20486 tablet_bootstrap.cc:492] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.197520 20486 ts_tablet_manager.cc:1367] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.085s user 0.007s sys 0.011s
I20240502 14:17:31.198457 20486 raft_consensus.cc:348] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.198784 20486 raft_consensus.cc:374] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.198907 20486 raft_consensus.cc:729] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.199278 20486 consensus_queue.cc:260] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.200074 20486 ts_tablet_manager.cc:1398] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:31.200520 20486 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.201798 20487 consensus_queue.cc:260] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.202281 20703 consensus_queue.cc:1035] T 39035e415e624aefadb9022d67a91419 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.202760 20487 ts_tablet_manager.cc:1398] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20240502 14:17:31.203243 20487 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.203701 20620 consensus_queue.cc:1035] T 0783d83eb7d948a18a5adffb5d6711ea P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.204167 20486 tablet_bootstrap.cc:654] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.205221 20487 tablet_bootstrap.cc:654] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.208082 20489 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.208508 20620 consensus_queue.cc:1035] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.210717 20489 tablet_bootstrap.cc:654] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.213277 20487 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.213639 20487 ts_tablet_manager.cc:1367] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.001s
I20240502 14:17:31.214809 20487 raft_consensus.cc:348] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.215247 20487 raft_consensus.cc:374] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.215370 20487 raft_consensus.cc:729] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.215842 20487 consensus_queue.cc:260] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.224354 20487 ts_tablet_manager.cc:1398] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20240502 14:17:31.224797 20487 tablet_bootstrap.cc:492] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.224828 20620 consensus_queue.cc:1035] T f30d3cdb558c479c8431e4a72f073355 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.229252 20486 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.229586 20486 ts_tablet_manager.cc:1367] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.005s
I20240502 14:17:31.230046 20195 catalog_manager.cc:5484] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:31.230994 20195 catalog_manager.cc:5484] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:31.238201 20510 raft_consensus.cc:482] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.238421 20510 raft_consensus.cc:504] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.239285 20510 leader_election.cc:288] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.239344 20489 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.239838 20489 ts_tablet_manager.cc:1367] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.011s
I20240502 14:17:31.240167 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "232519ff0f174c94893738b64a940863" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:31.240794 20261 leader_election.cc:341] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.240983 20489 raft_consensus.cc:348] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.241232 20489 raft_consensus.cc:374] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.241300 20489 raft_consensus.cc:729] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.241564 20489 consensus_queue.cc:260] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.241628 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "232519ff0f174c94893738b64a940863" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.242126 20487 tablet_bootstrap.cc:654] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.243131 20489 ts_tablet_manager.cc:1398] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 14:17:31.243268 20486 raft_consensus.cc:348] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:31.243794 20261 leader_election.cc:341] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.244303 20261 leader_election.cc:302] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.244642 20489 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.244776 20510 raft_consensus.cc:2726] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.247016 20703 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.244870 20486 raft_consensus.cc:374] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.247311 20486 raft_consensus.cc:729] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.248685 20486 consensus_queue.cc:260] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.249651 20486 ts_tablet_manager.cc:1398] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20240502 14:17:31.249919 20703 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.250082 20486 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.252645 20486 tablet_bootstrap.cc:654] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.261916 20195 catalog_manager.cc:5484] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.262945 20195 catalog_manager.cc:5484] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.266183 20510 consensus_queue.cc:1035] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.271816 20496 raft_consensus.cc:482] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.272056 20496 raft_consensus.cc:504] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.272835 20496 leader_election.cc:288] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.274348 20194 catalog_manager.cc:5484] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.274924 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "079e05082c0c4434a4dcabafa01bfba9" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.274449 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "079e05082c0c4434a4dcabafa01bfba9" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.276039 20297 raft_consensus.cc:2379] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:31.276604 20410 leader_election.cc:302] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.277163 20494 consensus_queue.cc:1035] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.277894 20703 raft_consensus.cc:3037] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.283947 20703 raft_consensus.cc:2726] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.285327 20490 consensus_queue.cc:1035] T 14a741834267475b957eb3203e8e0563 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.287385 20487 tablet_bootstrap.cc:492] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.287596 20487 ts_tablet_manager.cc:1367] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.063s user 0.012s sys 0.015s
I20240502 14:17:31.288447 20487 raft_consensus.cc:348] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.290402 20487 raft_consensus.cc:374] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.290499 20487 raft_consensus.cc:729] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.290773 20487 consensus_queue.cc:260] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.291438 20487 ts_tablet_manager.cc:1398] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:31.291926 20487 tablet_bootstrap.cc:492] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.294265 20487 tablet_bootstrap.cc:654] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.299584 20489 tablet_bootstrap.cc:654] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.301445 20703 raft_consensus.cc:482] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.301759 20703 raft_consensus.cc:504] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.305229 20703 leader_election.cc:288] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.307654 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b09e67785d84964a32c0c7f61d05516" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.307950 20293 raft_consensus.cc:2454] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.309244 20410 leader_election.cc:302] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.309917 20496 raft_consensus.cc:2781] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.310034 20496 raft_consensus.cc:482] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.310107 20496 raft_consensus.cc:3037] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.312551 20496 raft_consensus.cc:504] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.313259 20496 leader_election.cc:288] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.313848 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b09e67785d84964a32c0c7f61d05516" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.314080 20372 raft_consensus.cc:3037] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.314900 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b09e67785d84964a32c0c7f61d05516" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.315078 20293 raft_consensus.cc:3037] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.317037 20372 raft_consensus.cc:2454] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.317515 20293 raft_consensus.cc:2454] T 2b09e67785d84964a32c0c7f61d05516 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.318118 20410 leader_election.cc:302] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.318768 20496 raft_consensus.cc:2781] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.319193 20496 raft_consensus.cc:686] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.319595 20496 consensus_queue.cc:237] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.320036 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b09e67785d84964a32c0c7f61d05516" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.320253 20370 raft_consensus.cc:2362] T 2b09e67785d84964a32c0c7f61d05516 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1. Re-sending same reply.
I20240502 14:17:31.320684 20740 consensus_queue.cc:1035] T 984c1d6e64e84bcdb9f5644b8d8a3565 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.332360 20569 raft_consensus.cc:482] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.332556 20569 raft_consensus.cc:504] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.333343 20569 leader_election.cc:288] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.332229 20500 consensus_queue.cc:1035] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.334340 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.334383 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.334646 20370 raft_consensus.cc:2454] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
W20240502 14:17:31.335011 20261 leader_election.cc:341] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.335531 20261 leader_election.cc:302] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.336016 20569 raft_consensus.cc:2781] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.336117 20569 raft_consensus.cc:482] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.336190 20569 raft_consensus.cc:3037] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
W20240502 14:17:31.340167 20261 consensus_peers.cc:485] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Couldn't send request to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:31.340519 20569 raft_consensus.cc:504] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.341526 20569 leader_election.cc:288] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.342301 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.342603 20370 raft_consensus.cc:3037] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.346959 20370 raft_consensus.cc:2454] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.347862 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.348091 20261 leader_election.cc:302] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.348531 20566 raft_consensus.cc:2781] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.348703 20566 raft_consensus.cc:686] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.349013 20566 consensus_queue.cc:237] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:31.349176 20261 leader_election.cc:341] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.354342 20740 consensus_queue.cc:1035] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.363358 20494 raft_consensus.cc:482] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.363590 20494 raft_consensus.cc:504] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.364411 20494 leader_election.cc:288] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.365376 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.366760 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f095c3f4591249c0a657287a10657560" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.367645 20297 raft_consensus.cc:2379] T f095c3f4591249c0a657287a10657560 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in current term 1: Already voted for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in this term.
I20240502 14:17:31.369760 20195 catalog_manager.cc:5484] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.371587 20336 leader_election.cc:302] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.372191 20500 raft_consensus.cc:3037] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.375341 20500 raft_consensus.cc:2726] T f095c3f4591249c0a657287a10657560 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.375792 20192 catalog_manager.cc:5484] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:31.377549 20489 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.377745 20489 ts_tablet_manager.cc:1367] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.133s user 0.005s sys 0.000s
I20240502 14:17:31.378898 20489 raft_consensus.cc:348] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.379173 20489 raft_consensus.cc:374] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.379241 20489 raft_consensus.cc:729] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.379494 20489 consensus_queue.cc:260] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.380151 20489 ts_tablet_manager.cc:1398] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:17:31.380511 20489 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.383697 20487 tablet_bootstrap.cc:492] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.384608 20486 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.384768 20486 ts_tablet_manager.cc:1367] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.135s user 0.043s sys 0.043s
I20240502 14:17:31.384852 20487 ts_tablet_manager.cc:1367] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.093s user 0.043s sys 0.028s
I20240502 14:17:31.386329 20489 tablet_bootstrap.cc:654] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.386360 20487 raft_consensus.cc:348] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.386660 20487 raft_consensus.cc:374] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.386747 20487 raft_consensus.cc:729] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.387017 20487 consensus_queue.cc:260] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.387580 20569 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.387703 20487 ts_tablet_manager.cc:1398] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 14:17:31.388926 20487 tablet_bootstrap.cc:492] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.389210 20486 raft_consensus.cc:348] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.389452 20486 raft_consensus.cc:374] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.389523 20486 raft_consensus.cc:729] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.389783 20486 consensus_queue.cc:260] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.390764 20486 ts_tablet_manager.cc:1398] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 14:17:31.391085 20486 tablet_bootstrap.cc:492] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.392280 20489 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.392427 20489 ts_tablet_manager.cc:1367] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.001s
I20240502 14:17:31.393352 20487 tablet_bootstrap.cc:654] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.394971 20486 tablet_bootstrap.cc:654] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.396831 20489 raft_consensus.cc:348] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.397104 20489 raft_consensus.cc:374] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.397164 20489 raft_consensus.cc:729] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.397411 20489 consensus_queue.cc:260] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.398087 20489 ts_tablet_manager.cc:1398] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 14:17:31.398517 20489 tablet_bootstrap.cc:492] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.400956 20489 tablet_bootstrap.cc:654] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.409698 20489 tablet_bootstrap.cc:492] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.410094 20489 ts_tablet_manager.cc:1367] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20240502 14:17:31.411159 20489 raft_consensus.cc:348] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.411499 20489 raft_consensus.cc:374] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.411559 20489 raft_consensus.cc:729] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.411855 20489 consensus_queue.cc:260] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.412688 20489 ts_tablet_manager.cc:1398] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:31.413807 20489 tablet_bootstrap.cc:492] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.413703 20496 raft_consensus.cc:482] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.414197 20496 raft_consensus.cc:504] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.415045 20496 leader_election.cc:288] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.415556 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.415670 20487 tablet_bootstrap.cc:492] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.415789 20370 raft_consensus.cc:2379] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
I20240502 14:17:31.415961 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb046706fc504c47870d1f084489befe" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.416077 20486 tablet_bootstrap.cc:492] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.416220 20486 ts_tablet_manager.cc:1367] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.014s
I20240502 14:17:31.416501 20410 leader_election.cc:302] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.417120 20486 raft_consensus.cc:348] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.417313 20496 raft_consensus.cc:3037] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.417333 20486 raft_consensus.cc:374] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.417513 20486 raft_consensus.cc:729] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.415797 20487 ts_tablet_manager.cc:1367] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.007s
I20240502 14:17:31.417790 20486 consensus_queue.cc:260] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.418393 20486 ts_tablet_manager.cc:1398] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 14:17:31.418421 20487 raft_consensus.cc:348] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.418634 20487 raft_consensus.cc:374] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.418686 20487 raft_consensus.cc:729] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.418857 20486 tablet_bootstrap.cc:492] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.418893 20487 consensus_queue.cc:260] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.420362 20496 raft_consensus.cc:2726] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.421079 20486 tablet_bootstrap.cc:654] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.421597 20487 ts_tablet_manager.cc:1398] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 14:17:31.421923 20487 tablet_bootstrap.cc:492] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.423936 20487 tablet_bootstrap.cc:654] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.425762 20489 tablet_bootstrap.cc:654] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.428505 20740 consensus_queue.cc:1035] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.429347 20486 tablet_bootstrap.cc:492] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.429510 20486 ts_tablet_manager.cc:1367] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20240502 14:17:31.430299 20486 raft_consensus.cc:348] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.430511 20486 raft_consensus.cc:374] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.430605 20486 raft_consensus.cc:729] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.430827 20486 consensus_queue.cc:260] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.431521 20486 ts_tablet_manager.cc:1398] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:31.431958 20486 tablet_bootstrap.cc:492] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.432101 20703 raft_consensus.cc:482] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.432319 20703 raft_consensus.cc:504] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.433171 20703 leader_election.cc:288] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.433887 20486 tablet_bootstrap.cc:654] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.434445 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e989cc9924b04f018e332d78582556f1" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.434765 20297 raft_consensus.cc:2454] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.435454 20410 leader_election.cc:302] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.437084 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e989cc9924b04f018e332d78582556f1" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.437440 20370 raft_consensus.cc:2454] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.438191 20496 raft_consensus.cc:2781] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.438356 20496 raft_consensus.cc:482] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.438489 20496 raft_consensus.cc:3037] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.440253 20740 raft_consensus.cc:482] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.440471 20740 raft_consensus.cc:504] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.441180 20740 leader_election.cc:288] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.441926 20486 tablet_bootstrap.cc:492] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.442173 20486 ts_tablet_manager.cc:1367] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.001s
I20240502 14:17:31.442348 20740 consensus_queue.cc:1035] T a259e566bef947cba083ea525231254d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.443118 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b64648e3355c4ee789a240f6c34928bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.443485 20486 raft_consensus.cc:348] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.443722 20486 raft_consensus.cc:374] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.444576 20297 raft_consensus.cc:2454] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:31.445348 20336 leader_election.cc:302] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.445809 20486 raft_consensus.cc:729] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.446307 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b64648e3355c4ee789a240f6c34928bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.446882 20740 raft_consensus.cc:2781] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.448127 20486 consensus_queue.cc:260] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.451426 20740 raft_consensus.cc:482] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20240502 14:17:31.452100 20336 leader_election.cc:341] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.457742 20740 raft_consensus.cc:3037] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.457770 20487 tablet_bootstrap.cc:492] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.458344 20487 ts_tablet_manager.cc:1367] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.036s user 0.010s sys 0.008s
I20240502 14:17:31.460155 20740 raft_consensus.cc:504] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.460902 20740 leader_election.cc:288] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.461465 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b64648e3355c4ee789a240f6c34928bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
W20240502 14:17:31.462219 20336 leader_election.cc:341] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.462445 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b64648e3355c4ee789a240f6c34928bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.462747 20297 raft_consensus.cc:3037] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.462910 20496 raft_consensus.cc:504] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.463546 20496 leader_election.cc:288] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.463943 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e989cc9924b04f018e332d78582556f1" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.464222 20486 ts_tablet_manager.cc:1398] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240502 14:17:31.459501 20487 raft_consensus.cc:348] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.464987 20294 raft_consensus.cc:3037] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.466058 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e989cc9924b04f018e332d78582556f1" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.468250 20486 tablet_bootstrap.cc:492] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.469693 20370 raft_consensus.cc:3037] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.470482 20489 tablet_bootstrap.cc:492] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.470836 20487 raft_consensus.cc:374] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.471390 20487 raft_consensus.cc:729] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.473593 20370 raft_consensus.cc:2454] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.474032 20410 leader_election.cc:302] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.476083 20489 ts_tablet_manager.cc:1367] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.026s
I20240502 14:17:31.476166 20294 raft_consensus.cc:2454] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.476373 20297 raft_consensus.cc:2454] T b64648e3355c4ee789a240f6c34928bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.477010 20486 tablet_bootstrap.cc:654] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.476969 20487 consensus_queue.cc:260] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.477403 20703 consensus_queue.cc:1035] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240502 14:17:31.477499 20489 raft_consensus.cc:348] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.477730 20489 raft_consensus.cc:374] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.477839 20489 raft_consensus.cc:729] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.478044 20496 raft_consensus.cc:2781] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.478155 20489 consensus_queue.cc:260] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.478611 20496 raft_consensus.cc:686] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.478919 20489 ts_tablet_manager.cc:1398] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:31.479022 20496 consensus_queue.cc:237] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.479351 20489 tablet_bootstrap.cc:492] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.480386 20487 ts_tablet_manager.cc:1398] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20240502 14:17:31.480814 20487 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.481506 20489 tablet_bootstrap.cc:654] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.482465 20336 leader_election.cc:302] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.483304 20512 raft_consensus.cc:2781] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.483525 20512 raft_consensus.cc:686] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:31.483865 20512 consensus_queue.cc:237] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.485556 20487 tablet_bootstrap.cc:654] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.492223 20487 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.493014 20487 ts_tablet_manager.cc:1367] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.001s
I20240502 14:17:31.493036 20489 tablet_bootstrap.cc:492] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.493225 20489 ts_tablet_manager.cc:1367] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.007s
I20240502 14:17:31.494081 20487 raft_consensus.cc:348] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.494376 20487 raft_consensus.cc:374] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.494081 20489 raft_consensus.cc:348] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.494501 20487 raft_consensus.cc:729] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.494746 20489 raft_consensus.cc:374] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.494866 20489 raft_consensus.cc:729] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.494961 20487 consensus_queue.cc:260] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.495131 20489 consensus_queue.cc:260] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.495815 20489 ts_tablet_manager.cc:1398] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:31.496202 20489 tablet_bootstrap.cc:492] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.496769 20194 catalog_manager.cc:5484] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:31.497951 20487 ts_tablet_manager.cc:1398] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 14:17:31.498347 20487 tablet_bootstrap.cc:492] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.498454 20489 tablet_bootstrap.cc:654] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.499333 20552 consensus_queue.cc:1035] T 501adddb143b4c03bdf4b0e6476baeac P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.495469 20195 catalog_manager.cc:5484] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.506009 20486 tablet_bootstrap.cc:492] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.506268 20486 ts_tablet_manager.cc:1367] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20240502 14:17:31.507256 20486 raft_consensus.cc:348] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.507535 20486 raft_consensus.cc:374] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.507629 20486 raft_consensus.cc:729] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.507915 20486 consensus_queue.cc:260] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.511006 20486 ts_tablet_manager.cc:1398] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 14:17:31.511451 20487 tablet_bootstrap.cc:654] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.511535 20486 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.513974 20486 tablet_bootstrap.cc:654] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.523450 20486 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.523981 20486 ts_tablet_manager.cc:1367] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20240502 14:17:31.525380 20486 raft_consensus.cc:348] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.525790 20486 raft_consensus.cc:374] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.525923 20486 raft_consensus.cc:729] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.526279 20486 consensus_queue.cc:260] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.526640 20496 consensus_queue.cc:1035] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240502 14:17:31.526407 20487 tablet_bootstrap.cc:492] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.529109 20489 tablet_bootstrap.cc:492] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.529376 20489 ts_tablet_manager.cc:1367] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.033s user 0.020s sys 0.011s
I20240502 14:17:31.527240 20486 ts_tablet_manager.cc:1398] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20240502 14:17:31.530604 20486 tablet_bootstrap.cc:492] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.530371 20489 raft_consensus.cc:348] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.530851 20489 raft_consensus.cc:374] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.530966 20489 raft_consensus.cc:729] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.529134 20487 ts_tablet_manager.cc:1367] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.000s
I20240502 14:17:31.532058 20487 raft_consensus.cc:348] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.532389 20487 raft_consensus.cc:374] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.532508 20487 raft_consensus.cc:729] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.532820 20487 consensus_queue.cc:260] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.533419 20486 tablet_bootstrap.cc:654] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.533528 20487 ts_tablet_manager.cc:1398] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:31.533840 20489 consensus_queue.cc:260] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.534606 20489 ts_tablet_manager.cc:1398] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240502 14:17:31.535084 20487 tablet_bootstrap.cc:492] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.537403 20487 tablet_bootstrap.cc:654] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.539008 20489 tablet_bootstrap.cc:492] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.541085 20496 consensus_queue.cc:1035] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.541308 20489 tablet_bootstrap.cc:654] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.542358 20512 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.559340 20496 consensus_queue.cc:1035] T e4ebb8c62fbd49dea69b8f289df1bf60 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.580794 20512 raft_consensus.cc:482] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.581228 20512 raft_consensus.cc:504] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.582238 20512 leader_election.cc:288] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.583734 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c068958fef984876b58d2686669c82d8" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.584656 20295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c068958fef984876b58d2686669c82d8" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
W20240502 14:17:31.586629 20336 leader_election.cc:341] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
W20240502 14:17:31.587744 20336 leader_election.cc:341] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.587926 20336 leader_election.cc:302] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.589082 20740 raft_consensus.cc:2726] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.601286 20490 consensus_queue.cc:1035] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.603682 20490 raft_consensus.cc:482] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.603958 20490 raft_consensus.cc:504] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.604826 20490 leader_election.cc:288] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.606937 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a113e02ef5042539d2d575735a7ba9f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.607252 20369 raft_consensus.cc:2454] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.606350 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a113e02ef5042539d2d575735a7ba9f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.607781 20442 raft_consensus.cc:2454] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.608750 20261 leader_election.cc:302] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.609334 20552 consensus_queue.cc:1035] T f095c3f4591249c0a657287a10657560 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.609493 20490 raft_consensus.cc:2781] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.609606 20490 raft_consensus.cc:482] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.609716 20490 raft_consensus.cc:3037] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.613385 20490 raft_consensus.cc:504] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.616283 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a113e02ef5042539d2d575735a7ba9f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.616641 20371 raft_consensus.cc:3037] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.619050 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a113e02ef5042539d2d575735a7ba9f" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.619416 20442 raft_consensus.cc:3037] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.624951 20371 raft_consensus.cc:2454] T 8a113e02ef5042539d2d575735a7ba9f P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.625980 20261 leader_election.cc:302] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.626490 20569 raft_consensus.cc:2781] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.626765 20569 raft_consensus.cc:686] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.627149 20569 consensus_queue.cc:237] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.632243 20512 consensus_queue.cc:1035] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.637202 20512 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.639737 20442 raft_consensus.cc:2454] T 8a113e02ef5042539d2d575735a7ba9f P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.640293 20510 raft_consensus.cc:482] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.640532 20510 raft_consensus.cc:504] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.641330 20510 leader_election.cc:288] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.642979 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877ddfafada342978bfce99e7190f253" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
W20240502 14:17:31.643904 20261 leader_election.cc:341] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.643909 20740 consensus_queue.cc:1035] T ae70452bab2a4001b7e8b60170cbe230 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.644451 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877ddfafada342978bfce99e7190f253" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.644841 20371 raft_consensus.cc:2454] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.645483 20261 leader_election.cc:302] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.646015 20510 raft_consensus.cc:2781] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.646132 20510 raft_consensus.cc:482] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.646245 20510 raft_consensus.cc:3037] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.650257 20510 raft_consensus.cc:504] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.655227 20510 leader_election.cc:288] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.658779 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877ddfafada342978bfce99e7190f253" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.614456 20490 leader_election.cc:288] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
W20240502 14:17:31.662886 20261 leader_election.cc:341] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.667047 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877ddfafada342978bfce99e7190f253" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.667333 20369 raft_consensus.cc:3037] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.669281 20487 tablet_bootstrap.cc:492] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.669508 20487 ts_tablet_manager.cc:1367] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.135s user 0.011s sys 0.054s
I20240502 14:17:31.670329 20490 raft_consensus.cc:482] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.670506 20490 raft_consensus.cc:504] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.673532 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6d7c5a9de147b5b055198c5e6ec28a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.673969 20512 raft_consensus.cc:482] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.674139 20512 raft_consensus.cc:504] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:31.674280 20261 leader_election.cc:341] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.674708 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6d7c5a9de147b5b055198c5e6ec28a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.674841 20512 leader_election.cc:288] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.673972 20489 tablet_bootstrap.cc:492] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.675006 20372 raft_consensus.cc:2454] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.675127 20489 ts_tablet_manager.cc:1367] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.136s user 0.036s sys 0.030s
I20240502 14:17:31.675458 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d9972f6b3e44328639f1d4636b5f15" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.675664 20297 raft_consensus.cc:2454] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:31.675478 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d9972f6b3e44328639f1d4636b5f15" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.676005 20444 raft_consensus.cc:2454] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:31.676043 20489 raft_consensus.cc:348] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.671658 20490 leader_election.cc:288] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.676220 20489 raft_consensus.cc:374] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.676275 20489 raft_consensus.cc:729] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.676434 20336 leader_election.cc:302] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.676487 20489 consensus_queue.cc:260] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.670492 20487 raft_consensus.cc:348] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.676854 20487 raft_consensus.cc:374] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.676936 20487 raft_consensus.cc:729] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.677135 20512 raft_consensus.cc:2781] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.677263 20512 raft_consensus.cc:482] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.675253 20486 tablet_bootstrap.cc:492] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.677417 20512 raft_consensus.cc:3037] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.677508 20486 ts_tablet_manager.cc:1367] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.147s user 0.062s sys 0.053s
I20240502 14:17:31.678365 20486 raft_consensus.cc:348] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.678659 20486 raft_consensus.cc:374] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.678740 20486 raft_consensus.cc:729] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.678953 20486 consensus_queue.cc:260] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.679598 20486 ts_tablet_manager.cc:1398] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:31.679953 20486 tablet_bootstrap.cc:492] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.681120 20512 raft_consensus.cc:504] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.682196 20489 ts_tablet_manager.cc:1398] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 14:17:31.682482 20489 tablet_bootstrap.cc:492] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.682909 20512 leader_election.cc:288] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.677165 20487 consensus_queue.cc:260] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.683420 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d9972f6b3e44328639f1d4636b5f15" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.683629 20487 ts_tablet_manager.cc:1398] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.014s user 0.000s sys 0.003s
I20240502 14:17:31.683629 20446 raft_consensus.cc:3037] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.681638 20261 leader_election.cc:302] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.684376 20489 tablet_bootstrap.cc:654] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.681762 20486 tablet_bootstrap.cc:654] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.686187 20569 raft_consensus.cc:2781] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.686295 20569 raft_consensus.cc:482] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.686358 20569 raft_consensus.cc:3037] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.689479 20569 raft_consensus.cc:504] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.690042 20510 raft_consensus.cc:482] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.690189 20510 raft_consensus.cc:504] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.690817 20510 leader_election.cc:288] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.686198 20487 tablet_bootstrap.cc:492] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.691742 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607e42684e648b094b78dba336e623d" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.692227 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607e42684e648b094b78dba336e623d" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.692404 20443 raft_consensus.cc:2454] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.692442 20446 raft_consensus.cc:2454] T 25d9972f6b3e44328639f1d4636b5f15 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.692970 20487 tablet_bootstrap.cc:654] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.693002 20336 leader_election.cc:302] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.694584 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6d7c5a9de147b5b055198c5e6ec28a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.694783 20372 raft_consensus.cc:3037] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.694486 20620 raft_consensus.cc:2781] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.694967 20369 raft_consensus.cc:2454] T 877ddfafada342978bfce99e7190f253 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.695041 20620 raft_consensus.cc:686] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:31.695398 20620 consensus_queue.cc:237] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.696691 20569 leader_election.cc:288] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.705049 20372 raft_consensus.cc:2454] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.705475 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6d7c5a9de147b5b055198c5e6ec28a" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
W20240502 14:17:31.706133 20261 leader_election.cc:341] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.713660 20261 leader_election.cc:302] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.714653 20510 raft_consensus.cc:2781] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.715082 20261 leader_election.cc:302] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.715423 20261 leader_election.cc:302] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.715689 20569 raft_consensus.cc:2781] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
W20240502 14:17:31.716109 20261 leader_election.cc:341] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.716221 20566 raft_consensus.cc:2781] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.716661 20566 raft_consensus.cc:482] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.716748 20566 raft_consensus.cc:3037] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.710747 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d9972f6b3e44328639f1d4636b5f15" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.718519 20294 raft_consensus.cc:3037] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.719815 20444 raft_consensus.cc:3037] T 17ad302fb34c4af592576654060e05c8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.720103 20566 raft_consensus.cc:504] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.725219 20566 leader_election.cc:288] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.725538 20566 raft_consensus.cc:482] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.725931 20566 raft_consensus.cc:504] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.726713 20566 leader_election.cc:288] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.730767 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607e42684e648b094b78dba336e623d" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.730953 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607e42684e648b094b78dba336e623d" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.731134 20442 raft_consensus.cc:3037] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.731786 20446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c28c2c6be74c10a33f46e52affd378" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.732031 20446 raft_consensus.cc:2454] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.731808 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c28c2c6be74c10a33f46e52affd378" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:31.732663 20261 leader_election.cc:341] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.733899 20569 raft_consensus.cc:686] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.732923 20490 consensus_queue.cc:1035] T 17ad302fb34c4af592576654060e05c8 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240502 14:17:31.734236 20569 consensus_queue.cc:237] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.735805 20261 leader_election.cc:302] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
W20240502 14:17:31.736395 20261 leader_election.cc:341] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.736632 20486 tablet_bootstrap.cc:492] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.738301 20486 ts_tablet_manager.cc:1367] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.002s
I20240502 14:17:31.736722 20490 raft_consensus.cc:2781] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.739286 20490 raft_consensus.cc:482] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.739439 20490 raft_consensus.cc:3037] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.726425 20294 raft_consensus.cc:2454] T 25d9972f6b3e44328639f1d4636b5f15 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.736618 20442 raft_consensus.cc:2454] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.738659 20510 raft_consensus.cc:686] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.742866 20487 tablet_bootstrap.cc:492] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.742769 20510 consensus_queue.cc:237] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.743117 20487 ts_tablet_manager.cc:1367] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.057s user 0.017s sys 0.008s
I20240502 14:17:31.744515 20192 catalog_manager.cc:5484] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.744822 20487 raft_consensus.cc:348] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.745785 20487 raft_consensus.cc:374] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.745882 20487 raft_consensus.cc:729] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.746146 20487 consensus_queue.cc:260] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.746441 20261 leader_election.cc:302] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.746452 20370 raft_consensus.cc:3037] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.747321 20569 raft_consensus.cc:2781] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.744550 20486 raft_consensus.cc:348] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.747450 20486 raft_consensus.cc:374] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.747519 20486 raft_consensus.cc:729] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.748111 20489 tablet_bootstrap.cc:492] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.747462 20569 raft_consensus.cc:686] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.748809 20489 ts_tablet_manager.cc:1367] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.066s user 0.032s sys 0.032s
I20240502 14:17:31.748669 20486 consensus_queue.cc:260] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.749657 20486 ts_tablet_manager.cc:1398] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 14:17:31.749945 20486 tablet_bootstrap.cc:492] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.750034 20489 raft_consensus.cc:348] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.750236 20489 raft_consensus.cc:374] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.750293 20489 raft_consensus.cc:729] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.750572 20489 consensus_queue.cc:260] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.751226 20489 ts_tablet_manager.cc:1398] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:31.751581 20489 tablet_bootstrap.cc:492] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.751962 20486 tablet_bootstrap.cc:654] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.746896 20487 ts_tablet_manager.cc:1398] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 14:17:31.753245 20487 tablet_bootstrap.cc:492] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.754900 20490 raft_consensus.cc:504] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.755834 20490 leader_election.cc:288] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.756736 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c28c2c6be74c10a33f46e52affd378" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
W20240502 14:17:31.757635 20261 leader_election.cc:341] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.757833 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c28c2c6be74c10a33f46e52affd378" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.753582 20489 tablet_bootstrap.cc:654] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.749063 20569 consensus_queue.cc:237] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.758046 20442 raft_consensus.cc:3037] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.760082 20510 raft_consensus.cc:482] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.760262 20510 raft_consensus.cc:504] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.761123 20510 leader_election.cc:288] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.761677 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9bf018a7d1845ae9ebcfe4287e2d968" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:31.762570 20261 leader_election.cc:341] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.763782 20442 raft_consensus.cc:2454] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.765277 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9bf018a7d1845ae9ebcfe4287e2d968" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.765993 20261 leader_election.cc:302] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.766402 20510 raft_consensus.cc:2781] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.766659 20510 raft_consensus.cc:686] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.767066 20510 consensus_queue.cc:237] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:31.769320 20261 leader_election.cc:341] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.769498 20261 leader_election.cc:302] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.769901 20510 raft_consensus.cc:2726] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.772090 20487 tablet_bootstrap.cc:654] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.771620 20192 catalog_manager.cc:5484] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.772799 20192 catalog_manager.cc:5484] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.773861 20489 tablet_bootstrap.cc:492] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.774106 20489 ts_tablet_manager.cc:1367] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20240502 14:17:31.773862 20192 catalog_manager.cc:5484] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.775228 20489 raft_consensus.cc:348] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.775532 20489 raft_consensus.cc:374] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.775619 20489 raft_consensus.cc:729] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.777830 20487 tablet_bootstrap.cc:492] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.778048 20487 ts_tablet_manager.cc:1367] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20240502 14:17:31.779013 20487 raft_consensus.cc:348] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.779282 20487 raft_consensus.cc:374] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.779352 20487 raft_consensus.cc:729] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.779664 20487 consensus_queue.cc:260] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.780642 20487 ts_tablet_manager.cc:1398] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:31.781070 20487 tablet_bootstrap.cc:492] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.783658 20620 raft_consensus.cc:482] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.783839 20620 raft_consensus.cc:504] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.783804 20489 consensus_queue.cc:260] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.783810 20486 tablet_bootstrap.cc:492] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.784206 20486 ts_tablet_manager.cc:1367] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.034s user 0.014s sys 0.014s
I20240502 14:17:31.784423 20489 ts_tablet_manager.cc:1398] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20240502 14:17:31.784567 20620 leader_election.cc:288] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.784772 20489 tablet_bootstrap.cc:492] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.785055 20486 raft_consensus.cc:348] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.785246 20486 raft_consensus.cc:374] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.785295 20486 raft_consensus.cc:729] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.785301 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607e42684e648b094b78dba336e623d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.785571 20444 raft_consensus.cc:2379] T c607e42684e648b094b78dba336e623d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
I20240502 14:17:31.785521 20486 consensus_queue.cc:260] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.786096 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607e42684e648b094b78dba336e623d" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.786657 20489 tablet_bootstrap.cc:654] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.786993 20336 leader_election.cc:302] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.788034 20620 raft_consensus.cc:3037] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.788193 20486 ts_tablet_manager.cc:1398] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 14:17:31.789373 20486 tablet_bootstrap.cc:492] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.789378 20487 tablet_bootstrap.cc:654] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.791641 20569 raft_consensus.cc:482] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.791797 20569 raft_consensus.cc:504] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.792390 20569 leader_election.cc:288] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.792850 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e43e1388daf349469f3c7ae8a0eb3d7c" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.793077 20370 raft_consensus.cc:2454] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:31.795208 20486 tablet_bootstrap.cc:654] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.795557 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e43e1388daf349469f3c7ae8a0eb3d7c" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.799098 20261 leader_election.cc:302] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.799530 20569 raft_consensus.cc:2781] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.799616 20569 raft_consensus.cc:482] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.799714 20569 raft_consensus.cc:3037] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.803896 20620 raft_consensus.cc:2726] T c607e42684e648b094b78dba336e623d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.805472 20192 catalog_manager.cc:5484] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.805833 20569 raft_consensus.cc:504] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.806212 20192 catalog_manager.cc:5484] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.807044 20569 leader_election.cc:288] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
W20240502 14:17:31.807848 20261 leader_election.cc:341] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.808167 20489 tablet_bootstrap.cc:492] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.808341 20489 ts_tablet_manager.cc:1367] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.011s
I20240502 14:17:31.808944 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e43e1388daf349469f3c7ae8a0eb3d7c" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.809228 20489 raft_consensus.cc:348] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.809439 20489 raft_consensus.cc:374] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.809496 20489 raft_consensus.cc:729] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.809726 20489 consensus_queue.cc:260] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:31.809753 20261 leader_election.cc:341] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.811422 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e43e1388daf349469f3c7ae8a0eb3d7c" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.811614 20369 raft_consensus.cc:3037] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.811559 20569 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.811839 20487 tablet_bootstrap.cc:492] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.811993 20487 ts_tablet_manager.cc:1367] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.000s
I20240502 14:17:31.812855 20487 raft_consensus.cc:348] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.813078 20487 raft_consensus.cc:374] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.813149 20487 raft_consensus.cc:729] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.813421 20487 consensus_queue.cc:260] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.814148 20487 ts_tablet_manager.cc:1398] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:31.814483 20487 tablet_bootstrap.cc:492] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac: Bootstrap starting.
I20240502 14:17:31.816687 20487 tablet_bootstrap.cc:654] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.817427 20496 raft_consensus.cc:482] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.817548 20496 raft_consensus.cc:504] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.818233 20496 leader_election.cc:288] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.819092 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "232519ff0f174c94893738b64a940863" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.819314 20294 raft_consensus.cc:2454] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.819713 20410 leader_election.cc:302] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.820230 20496 raft_consensus.cc:2781] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.820257 20486 tablet_bootstrap.cc:492] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.820307 20496 raft_consensus.cc:482] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.820369 20496 raft_consensus.cc:3037] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.820423 20486 ts_tablet_manager.cc:1367] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.005s
I20240502 14:17:31.819092 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "232519ff0f174c94893738b64a940863" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.820770 20372 raft_consensus.cc:2454] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.821561 20486 raft_consensus.cc:348] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.821852 20486 raft_consensus.cc:374] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.821938 20486 raft_consensus.cc:729] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.822294 20486 consensus_queue.cc:260] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.823246 20486 ts_tablet_manager.cc:1398] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 14:17:31.823659 20486 tablet_bootstrap.cc:492] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.817257 20369 raft_consensus.cc:2454] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:31.823982 20707 consensus_queue.cc:1035] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.824620 20261 leader_election.cc:302] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.825284 20569 raft_consensus.cc:2781] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.825409 20569 raft_consensus.cc:686] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:31.825673 20569 consensus_queue.cc:237] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.826236 20486 tablet_bootstrap.cc:654] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.827234 20496 raft_consensus.cc:504] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.828500 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "232519ff0f174c94893738b64a940863" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.828742 20293 raft_consensus.cc:3037] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.828791 20487 tablet_bootstrap.cc:492] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac: No bootstrap required, opened a new log
I20240502 14:17:31.829005 20487 ts_tablet_manager.cc:1367] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20240502 14:17:31.830135 20487 raft_consensus.cc:348] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.830420 20487 raft_consensus.cc:374] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.830485 20487 raft_consensus.cc:729] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.830792 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "232519ff0f174c94893738b64a940863" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.830964 20369 raft_consensus.cc:3037] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.830991 20487 consensus_queue.cc:260] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.831952 20487 ts_tablet_manager.cc:1398] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240502 14:17:31.832046 20293 raft_consensus.cc:2454] T 232519ff0f174c94893738b64a940863 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.833772 20369 raft_consensus.cc:2454] T 232519ff0f174c94893738b64a940863 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.834178 20410 leader_election.cc:302] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:31.834666 20707 raft_consensus.cc:2781] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.834801 20707 raft_consensus.cc:686] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.835114 20707 consensus_queue.cc:237] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.836162 20486 tablet_bootstrap.cc:492] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.836337 20486 ts_tablet_manager.cc:1367] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.005s
I20240502 14:17:31.837270 20486 raft_consensus.cc:348] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.837527 20486 raft_consensus.cc:374] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.837589 20486 raft_consensus.cc:729] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.837841 20486 consensus_queue.cc:260] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.838732 20486 ts_tablet_manager.cc:1398] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240502 14:17:31.839236 20486 tablet_bootstrap.cc:492] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.841217 20490 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.841643 20486 tablet_bootstrap.cc:654] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.846302 20490 raft_consensus.cc:482] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.846623 20490 raft_consensus.cc:504] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.847539 20490 leader_election.cc:288] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.849252 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17922984561e4a82922c5080dd75e8c3" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.849252 20372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17922984561e4a82922c5080dd75e8c3" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
W20240502 14:17:31.850708 20261 leader_election.cc:341] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.834815 20496 leader_election.cc:288] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
W20240502 14:17:31.850961 20261 leader_election.cc:341] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.851532 20261 leader_election.cc:302] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:31.851692 20704 consensus_queue.cc:1035] T 2b09e67785d84964a32c0c7f61d05516 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.852039 20510 raft_consensus.cc:2726] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.853564 20486 tablet_bootstrap.cc:492] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.853781 20486 ts_tablet_manager.cc:1367] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.003s
I20240502 14:17:31.854795 20486 raft_consensus.cc:348] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.855057 20486 raft_consensus.cc:374] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.855181 20486 raft_consensus.cc:729] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.855449 20486 consensus_queue.cc:260] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.855468 20489 ts_tablet_manager.cc:1398] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.047s user 0.002s sys 0.001s
I20240502 14:17:31.856077 20486 ts_tablet_manager.cc:1398] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:31.856245 20489 tablet_bootstrap.cc:492] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.856395 20486 tablet_bootstrap.cc:492] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.864856 20194 catalog_manager.cc:5484] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.865983 20192 catalog_manager.cc:5484] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:31.868897 20489 tablet_bootstrap.cc:654] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.870801 20486 tablet_bootstrap.cc:654] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.872689 20489 tablet_bootstrap.cc:492] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.872953 20489 ts_tablet_manager.cc:1367] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20240502 14:17:31.873824 20489 raft_consensus.cc:348] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.874125 20489 raft_consensus.cc:374] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.874244 20489 raft_consensus.cc:729] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.874572 20489 consensus_queue.cc:260] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.875273 20489 ts_tablet_manager.cc:1398] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:31.875653 20489 tablet_bootstrap.cc:492] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.878119 20489 tablet_bootstrap.cc:654] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.878679 20486 tablet_bootstrap.cc:492] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.878932 20486 ts_tablet_manager.cc:1367] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.001s
I20240502 14:17:31.879843 20486 raft_consensus.cc:348] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.880219 20486 raft_consensus.cc:374] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.880353 20489 tablet_bootstrap.cc:492] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.880352 20486 raft_consensus.cc:729] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.880612 20489 ts_tablet_manager.cc:1367] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 14:17:31.880945 20486 consensus_queue.cc:260] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.881408 20489 raft_consensus.cc:348] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.881666 20489 raft_consensus.cc:374] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.881754 20489 raft_consensus.cc:729] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.882090 20489 consensus_queue.cc:260] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.882867 20489 ts_tablet_manager.cc:1398] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:31.883443 20489 tablet_bootstrap.cc:492] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.884737 20486 ts_tablet_manager.cc:1398] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 14:17:31.885113 20486 tablet_bootstrap.cc:492] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Bootstrap starting.
I20240502 14:17:31.885192 20489 tablet_bootstrap.cc:654] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.886564 20621 raft_consensus.cc:482] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.886771 20621 raft_consensus.cc:504] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.887495 20621 leader_election.cc:288] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.887643 20486 tablet_bootstrap.cc:654] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.888806 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83adcbc5033e4631babb7517f375a1bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.889098 20294 raft_consensus.cc:2454] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:31.889122 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83adcbc5033e4631babb7517f375a1bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.889776 20336 leader_election.cc:302] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
W20240502 14:17:31.890483 20336 leader_election.cc:341] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.891166 20621 raft_consensus.cc:2781] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.891317 20621 raft_consensus.cc:482] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.891413 20621 raft_consensus.cc:3037] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.892988 20620 raft_consensus.cc:482] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.893177 20620 raft_consensus.cc:504] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.893884 20620 leader_election.cc:288] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.894433 20486 tablet_bootstrap.cc:492] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: No bootstrap required, opened a new log
I20240502 14:17:31.894644 20486 ts_tablet_manager.cc:1367] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20240502 14:17:31.894683 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c28c2c6be74c10a33f46e52affd378" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:31.895033 20444 raft_consensus.cc:2379] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
I20240502 14:17:31.896005 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45c28c2c6be74c10a33f46e52affd378" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.896135 20486 raft_consensus.cc:348] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.896391 20486 raft_consensus.cc:374] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.896504 20486 raft_consensus.cc:729] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.896792 20486 consensus_queue.cc:260] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.897166 20621 raft_consensus.cc:504] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.897437 20486 ts_tablet_manager.cc:1398] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 14:17:31.897984 20621 leader_election.cc:288] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:31.898294 20336 leader_election.cc:302] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.898492 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83adcbc5033e4631babb7517f375a1bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.898741 20294 raft_consensus.cc:3037] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.898865 20489 tablet_bootstrap.cc:492] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.899051 20489 ts_tablet_manager.cc:1367] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.006s
I20240502 14:17:31.898999 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83adcbc5033e4631babb7517f375a1bc" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:31.899958 20489 raft_consensus.cc:348] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.900182 20489 raft_consensus.cc:374] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.900285 20489 raft_consensus.cc:729] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.900533 20489 consensus_queue.cc:260] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
W20240502 14:17:31.900971 20336 leader_election.cc:341] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): Illegal state: must be running to vote when last-logged opid is not known
I20240502 14:17:31.901366 20294 raft_consensus.cc:2454] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:31.901772 20621 raft_consensus.cc:3037] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.902349 20489 ts_tablet_manager.cc:1398] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:31.902760 20489 tablet_bootstrap.cc:492] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.904769 20489 tablet_bootstrap.cc:654] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.905025 20621 raft_consensus.cc:2726] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:31.905949 20336 leader_election.cc:302] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters: 3d3f7ef2c14146fda4d1dba8a5ac597d
I20240502 14:17:31.906327 20621 raft_consensus.cc:2781] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.906683 20621 raft_consensus.cc:686] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:31.906972 20489 tablet_bootstrap.cc:492] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.907177 20489 ts_tablet_manager.cc:1367] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240502 14:17:31.907123 20621 consensus_queue.cc:237] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.908061 20489 raft_consensus.cc:348] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.908319 20489 raft_consensus.cc:374] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.908488 20489 raft_consensus.cc:729] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.908789 20489 consensus_queue.cc:260] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.910452 20489 ts_tablet_manager.cc:1398] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 14:17:31.910876 20489 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.911203 20195 catalog_manager.cc:5484] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:31.912457 20489 tablet_bootstrap.cc:654] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.915068 20489 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.915366 20489 ts_tablet_manager.cc:1367] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20240502 14:17:31.916234 20489 raft_consensus.cc:348] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.916471 20489 raft_consensus.cc:374] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.916589 20489 raft_consensus.cc:729] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.916885 20489 consensus_queue.cc:260] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.917557 20489 ts_tablet_manager.cc:1398] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:31.917878 20489 tablet_bootstrap.cc:492] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.919613 20489 tablet_bootstrap.cc:654] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.922024 20489 tablet_bootstrap.cc:492] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.922259 20489 ts_tablet_manager.cc:1367] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 14:17:31.923084 20489 raft_consensus.cc:348] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.923310 20489 raft_consensus.cc:374] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.923399 20489 raft_consensus.cc:729] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.923663 20489 consensus_queue.cc:260] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.924124 20489 ts_tablet_manager.cc:1398] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:17:31.924449 20489 tablet_bootstrap.cc:492] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Bootstrap starting.
I20240502 14:17:31.926045 20489 tablet_bootstrap.cc:654] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Neither blocks nor log segments found. Creating new log.
I20240502 14:17:31.928297 20489 tablet_bootstrap.cc:492] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d: No bootstrap required, opened a new log
I20240502 14:17:31.928504 20489 ts_tablet_manager.cc:1367] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 14:17:31.929422 20489 raft_consensus.cc:348] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.929668 20489 raft_consensus.cc:374] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 14:17:31.929793 20489 raft_consensus.cc:729] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Initialized, Role: FOLLOWER
I20240502 14:17:31.930064 20703 raft_consensus.cc:482] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:31.930056 20489 consensus_queue.cc:260] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.930265 20703 raft_consensus.cc:504] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.930826 20489 ts_tablet_manager.cc:1398] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240502 14:17:31.931046 20703 leader_election.cc:288] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.931699 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c068958fef984876b58d2686669c82d8" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:31.931775 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c068958fef984876b58d2686669c82d8" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:31.931923 20294 raft_consensus.cc:2454] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.931979 20369 raft_consensus.cc:2454] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:31.932336 20410 leader_election.cc:302] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.932418 20621 consensus_queue.cc:1035] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.932706 20703 raft_consensus.cc:2781] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:31.932816 20703 raft_consensus.cc:482] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:31.932938 20703 raft_consensus.cc:3037] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.942270 20444 raft_consensus.cc:3037] T b64648e3355c4ee789a240f6c34928bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.946794 20512 consensus_queue.cc:1035] T b64648e3355c4ee789a240f6c34928bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:31.951241 20703 raft_consensus.cc:504] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.952080 20703 leader_election.cc:288] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:31.952534 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c068958fef984876b58d2686669c82d8" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:31.952731 20294 raft_consensus.cc:3037] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.953804 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c068958fef984876b58d2686669c82d8" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:31.954001 20369 raft_consensus.cc:3037] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:31.955641 20294 raft_consensus.cc:2454] T c068958fef984876b58d2686669c82d8 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.956094 20410 leader_election.cc:302] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:31.956424 20703 raft_consensus.cc:2781] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:31.956547 20369 raft_consensus.cc:2454] T c068958fef984876b58d2686669c82d8 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:31.956609 20703 raft_consensus.cc:686] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:31.956916 20703 consensus_queue.cc:237] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:31.961465 20195 catalog_manager.cc:5484] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:32.021230 20490 raft_consensus.cc:482] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:32.021503 20490 raft_consensus.cc:504] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.022421 20490 leader_election.cc:288] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:32.023468 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b128b85dee4063a827684124960317" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:32.023502 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b128b85dee4063a827684124960317" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:32.023824 20369 raft_consensus.cc:2454] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:32.023893 20444 raft_consensus.cc:2454] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 0.
I20240502 14:17:32.024406 20261 leader_election.cc:302] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:32.025045 20490 raft_consensus.cc:2781] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:32.025187 20490 raft_consensus.cc:482] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:32.025265 20490 raft_consensus.cc:3037] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.028489 20490 raft_consensus.cc:504] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.029412 20490 leader_election.cc:288] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Requested vote from peers cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:32.030031 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b128b85dee4063a827684124960317" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:32.030087 20444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b128b85dee4063a827684124960317" candidate_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:32.030290 20444 raft_consensus.cc:3037] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.030288 20369 raft_consensus.cc:3037] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.032855 20444 raft_consensus.cc:2454] T 71b128b85dee4063a827684124960317 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:32.033620 20261 leader_election.cc:302] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters:
I20240502 14:17:32.033974 20490 raft_consensus.cc:2781] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:32.034304 20369 raft_consensus.cc:2454] T 71b128b85dee4063a827684124960317 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e6d73ccbc9463cbc192df0e4d125ac in term 1.
I20240502 14:17:32.034312 20490 raft_consensus.cc:686] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Becoming Leader. State: Replica: 14e6d73ccbc9463cbc192df0e4d125ac, State: Running, Role: LEADER
I20240502 14:17:32.034322 20703 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.034862 20490 consensus_queue.cc:237] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.039414 20195 catalog_manager.cc:5484] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1). New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:32.046103 20496 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 14:17:32.059207 20243 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 14:17:32.087579 20490 consensus_queue.cc:1035] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.093628 20490 consensus_queue.cc:1035] T 8a113e02ef5042539d2d575735a7ba9f P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.099400 20512 consensus_queue.cc:1035] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.105288 20500 consensus_queue.cc:1035] T 25d9972f6b3e44328639f1d4636b5f15 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.131702 20444 raft_consensus.cc:3037] T 877ddfafada342978bfce99e7190f253 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.135648 20490 consensus_queue.cc:1035] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240502 14:17:32.141553 20569 consensus_queue.cc:1035] T 877ddfafada342978bfce99e7190f253 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.141552 20496 raft_consensus.cc:482] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:32.141884 20496 raft_consensus.cc:504] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.142604 20496 leader_election.cc:288] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:32.143702 20370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9bf018a7d1845ae9ebcfe4287e2d968" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:32.143951 20370 raft_consensus.cc:2454] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:32.144183 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9bf018a7d1845ae9ebcfe4287e2d968" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:32.144399 20410 leader_election.cc:302] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:32.144446 20294 raft_consensus.cc:2454] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 0.
I20240502 14:17:32.144807 20704 raft_consensus.cc:2781] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:32.144897 20704 raft_consensus.cc:482] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:32.144974 20704 raft_consensus.cc:3037] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.148044 20704 raft_consensus.cc:504] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.148748 20704 leader_election.cc:288] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:32.149381 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9bf018a7d1845ae9ebcfe4287e2d968" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:32.149425 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9bf018a7d1845ae9ebcfe4287e2d968" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63"
I20240502 14:17:32.149633 20369 raft_consensus.cc:3037] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.149613 20294 raft_consensus.cc:3037] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.152436 20369 raft_consensus.cc:2454] T b9bf018a7d1845ae9ebcfe4287e2d968 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:32.152809 20410 leader_election.cc:302] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:32.152870 20294 raft_consensus.cc:2454] T b9bf018a7d1845ae9ebcfe4287e2d968 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in term 1.
I20240502 14:17:32.153141 20496 raft_consensus.cc:2781] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:32.153296 20496 raft_consensus.cc:686] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Becoming Leader. State: Replica: 3d3f7ef2c14146fda4d1dba8a5ac597d, State: Running, Role: LEADER
I20240502 14:17:32.153597 20496 consensus_queue.cc:237] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.155030 20621 raft_consensus.cc:482] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:32.155164 20621 raft_consensus.cc:504] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.155735 20621 leader_election.cc:288] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:32.156160 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17922984561e4a82922c5080dd75e8c3" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:32.156411 20294 raft_consensus.cc:2454] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:32.156809 20336 leader_election.cc:302] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:32.157094 20621 raft_consensus.cc:2781] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 14:17:32.157174 20621 raft_consensus.cc:482] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 14:17:32.157260 20621 raft_consensus.cc:3037] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.156160 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17922984561e4a82922c5080dd75e8c3" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" is_pre_election: true
I20240502 14:17:32.157729 20442 raft_consensus.cc:2454] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 0.
I20240502 14:17:32.158952 20194 catalog_manager.cc:5484] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3). New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } }
I20240502 14:17:32.160064 20621 raft_consensus.cc:504] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.160682 20621 leader_election.cc:288] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Requested vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:32.161408 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17922984561e4a82922c5080dd75e8c3" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac"
I20240502 14:17:32.161638 20294 raft_consensus.cc:3037] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.163887 20294 raft_consensus.cc:2454] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:32.164312 20442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17922984561e4a82922c5080dd75e8c3" candidate_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d"
I20240502 14:17:32.164382 20336 leader_election.cc:302] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63; no voters:
I20240502 14:17:32.164561 20442 raft_consensus.cc:3037] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.164703 20621 raft_consensus.cc:2781] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 14:17:32.164842 20621 raft_consensus.cc:686] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Becoming Leader. State: Replica: cb48b1aadcdc4b5b9ebfd1375b7bcb63, State: Running, Role: LEADER
I20240502 14:17:32.165117 20621 consensus_queue.cc:237] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.167263 20442 raft_consensus.cc:2454] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in term 1.
I20240502 14:17:32.168785 20194 catalog_manager.cc:5484] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2). New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:32.179682 20569 consensus_queue.cc:1035] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.185809 20510 consensus_queue.cc:1035] T c607e42684e648b094b78dba336e623d P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.196780 20510 consensus_queue.cc:1035] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.205693 20569 consensus_queue.cc:1035] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.223295 20496 raft_consensus.cc:482] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:32.223490 20496 raft_consensus.cc:504] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.224241 20496 leader_election.cc:288] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:32.224629 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e43e1388daf349469f3c7ae8a0eb3d7c" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:32.224639 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e43e1388daf349469f3c7ae8a0eb3d7c" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:32.224877 20369 raft_consensus.cc:2379] T e43e1388daf349469f3c7ae8a0eb3d7c P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate 14e6d73ccbc9463cbc192df0e4d125ac in this term.
I20240502 14:17:32.225422 20410 leader_election.cc:302] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:32.225756 20496 raft_consensus.cc:3037] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.228053 20496 raft_consensus.cc:2726] T e43e1388daf349469f3c7ae8a0eb3d7c P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:32.267678 20442 raft_consensus.cc:3037] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.271785 20814 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.278306 20510 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.288744 20510 consensus_queue.cc:1035] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.291695 20496 consensus_queue.cc:1035] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.296455 20510 consensus_queue.cc:1035] T e43e1388daf349469f3c7ae8a0eb3d7c P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.300323 20496 consensus_queue.cc:1035] T 232519ff0f174c94893738b64a940863 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.368777 20496 raft_consensus.cc:482] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 14:17:32.368974 20496 raft_consensus.cc:504] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } }
I20240502 14:17:32.369904 20496 leader_election.cc:288] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599), cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:32.370188 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83adcbc5033e4631babb7517f375a1bc" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" is_pre_election: true
I20240502 14:17:32.370504 20297 raft_consensus.cc:2379] T 83adcbc5033e4631babb7517f375a1bc P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d3f7ef2c14146fda4d1dba8a5ac597d in current term 1: Already voted for candidate cb48b1aadcdc4b5b9ebfd1375b7bcb63 in this term.
I20240502 14:17:32.370458 20369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83adcbc5033e4631babb7517f375a1bc" candidate_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" is_pre_election: true
I20240502 14:17:32.371364 20410 leader_election.cc:302] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3f7ef2c14146fda4d1dba8a5ac597d; no voters: 14e6d73ccbc9463cbc192df0e4d125ac, cb48b1aadcdc4b5b9ebfd1375b7bcb63
I20240502 14:17:32.371738 20496 raft_consensus.cc:3037] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 0 FOLLOWER]: Advancing to term 1
I20240502 14:17:32.373966 20496 raft_consensus.cc:2726] T 83adcbc5033e4631babb7517f375a1bc P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 14:17:32.413472 20621 consensus_queue.cc:1035] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.421065 20500 consensus_queue.cc:1035] T 83adcbc5033e4631babb7517f375a1bc P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.429175 19136 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 14:17:32.433194 20873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 14:17:32.433519 20874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:32.434866 19136 server_base.cc:1034] running on GCE node
W20240502 14:17:32.435429 20876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 14:17:32.435900 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 14:17:32.435982 19136 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 14:17:32.436038 19136 hybrid_clock.cc:648] HybridClock initialized: now 1714659452436032 us; error 0 us; skew 500 ppm
I20240502 14:17:32.436226 19136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 14:17:32.438180 19136 webserver.cc:460] Webserver started at http://127.18.176.4:39675/ using document root <none> and password file <none>
I20240502 14:17:32.438499 19136 fs_manager.cc:359] Metadata directory not provided
I20240502 14:17:32.438655 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 14:17:32.438936 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 14:17:32.439867 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-3-root/instance:
uuid: "e0f292d80247413b9d1b6ef13fc61aea"
format_stamp: "Formatted at 2024-05-02 14:17:32 on dist-test-slave-02q2"
I20240502 14:17:32.444039 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s
I20240502 14:17:32.446198 20881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:32.446871 19136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240502 14:17:32.447093 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-3-root
uuid: "e0f292d80247413b9d1b6ef13fc61aea"
format_stamp: "Formatted at 2024-05-02 14:17:32 on dist-test-slave-02q2"
I20240502 14:17:32.447283 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 14:17:32.452277 20510 consensus_queue.cc:1035] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.474262 19136 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 14:17:32.474614 20566 consensus_queue.cc:1035] T 71b128b85dee4063a827684124960317 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.475298 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 14:17:32.478621 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 14:17:32.480368 19136 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 14:17:32.480459 19136 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:32.480556 19136 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 14:17:32.480595 19136 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 14:17:32.497916 19136 rpc_server.cc:307] RPC server started. Bound to: 127.18.176.4:33345
I20240502 14:17:32.497974 20945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.176.4:33345 every 8 connection(s)
I20240502 14:17:32.498210 20707 consensus_queue.cc:1035] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.508839 19136 auto_leader_rebalancer-test.cc:405] add a tserver: e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:32.517792 20704 consensus_queue.cc:1035] T c068958fef984876b58d2686669c82d8 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.523903 20946 heartbeater.cc:347] Connected to a master server at 127.18.176.62:42365
I20240502 14:17:32.524215 20946 heartbeater.cc:464] Registering TS with master...
I20240502 14:17:32.524989 20946 heartbeater.cc:511] Master 127.18.176.62:42365 requested a full tablet report, sending...
I20240502 14:17:32.526485 20195 ts_manager.cc:194] Registered new tserver with Master: e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345)
I20240502 14:17:32.527590 20195 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45036
I20240502 14:17:32.613584 20704 consensus_queue.cc:1035] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.622367 20496 consensus_queue.cc:1035] T b9bf018a7d1845ae9ebcfe4287e2d968 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.660701 20500 consensus_queue.cc:1035] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:32.667191 20500 consensus_queue.cc:1035] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 14:17:33.090472 20370 consensus_queue.cc:237] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.094273 20294 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.095166 20621 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.095635 20444 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.096324 20621 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.100014 20500 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.103601 20294 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
W20240502 14:17:33.104874 20337 consensus_peers.cc:485] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 449e6e4e1a274922aa9bf52b2ce7d025. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:33.105567 20444 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.119030 20194 catalog_manager.cc:5484] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:33.131582 20294 consensus_queue.cc:237] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.147770 20370 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.147770 20444 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.148535 20566 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.148923 20814 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240502 14:17:33.155000 20262 consensus_peers.cc:485] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f956dfc843814ccd92546e00110c79ca. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:33.160044 20814 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.160840 20444 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.161566 20370 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.168363 20192 catalog_manager.cc:5484] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:33.172667 20294 consensus_queue.cc:237] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
W20240502 14:17:33.175720 20262 consensus_peers.cc:485] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d6d7c5a9de147b5b055198c5e6ec28a. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:33.176357 20371 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.179286 20566 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.179477 20444 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.180079 20566 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.183887 20566 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.184685 20444 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.184916 20370 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.192847 20370 consensus_queue.cc:237] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.192915 20195 catalog_manager.cc:5484] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.213734 20294 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:33.214186 20337 consensus_peers.cc:485] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adc2243a26fa4068aa4aa7424062292d. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:33.214289 20621 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.214593 20444 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:33.215188 20621 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:33.217667 20620 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.218645 20294 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.224833 20194 catalog_manager.cc:5484] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:33.224887 20444 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:33.530799 20946 heartbeater.cc:503] Master 127.18.176.62:42365 was elected leader, sending a full tablet report...
I20240502 14:17:33.595405 20975 ts_tablet_manager.cc:902] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:33.599244 20975 tablet_copy_client.cc:308] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.2:35997
I20240502 14:17:33.608484 20382 tablet_copy_service.cc:140] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Received BeginTabletCopySession request for tablet 449e6e4e1a274922aa9bf52b2ce7d025 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:55850)
I20240502 14:17:33.608709 20382 tablet_copy_service.cc:161] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Beginning new tablet copy session on tablet 449e6e4e1a274922aa9bf52b2ce7d025 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:55850: session id = e0f292d80247413b9d1b6ef13fc61aea-449e6e4e1a274922aa9bf52b2ce7d025
I20240502 14:17:33.612761 20382 tablet_copy_source_session.cc:205] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:33.615301 20975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449e6e4e1a274922aa9bf52b2ce7d025. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:33.622298 20975 tablet_copy_client.cc:783] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:33.622730 20975 tablet_copy_client.cc:647] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:33.625584 20975 tablet_copy_client.cc:523] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:33.629863 20975 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:33.638512 20975 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:33.639077 20975 tablet_bootstrap.cc:492] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:33.639377 20975 ts_tablet_manager.cc:1367] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.010s user 0.011s sys 0.001s
I20240502 14:17:33.640348 20975 raft_consensus.cc:348] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.640610 20975 raft_consensus.cc:729] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:33.640854 20975 consensus_queue.cc:260] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.641809 20975 ts_tablet_manager.cc:1398] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 14:17:33.643375 20382 tablet_copy_service.cc:342] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-449e6e4e1a274922aa9bf52b2ce7d025 received from {username='slave'} at 127.0.0.1:55850
I20240502 14:17:33.643573 20382 tablet_copy_service.cc:433] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-449e6e4e1a274922aa9bf52b2ce7d025 on tablet 449e6e4e1a274922aa9bf52b2ce7d025 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:33.744918 20975 ts_tablet_manager.cc:902] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:33.750893 20975 tablet_copy_client.cc:308] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.1:46599
I20240502 14:17:33.758386 20307 tablet_copy_service.cc:140] P 14e6d73ccbc9463cbc192df0e4d125ac: Received BeginTabletCopySession request for tablet 6d6d7c5a9de147b5b055198c5e6ec28a from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:35946)
I20240502 14:17:33.758651 20307 tablet_copy_service.cc:161] P 14e6d73ccbc9463cbc192df0e4d125ac: Beginning new tablet copy session on tablet 6d6d7c5a9de147b5b055198c5e6ec28a from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:35946: session id = e0f292d80247413b9d1b6ef13fc61aea-6d6d7c5a9de147b5b055198c5e6ec28a
I20240502 14:17:33.761734 20307 tablet_copy_source_session.cc:205] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:33.763368 20975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6d7c5a9de147b5b055198c5e6ec28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:33.763474 20990 ts_tablet_manager.cc:902] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:33.769254 20975 tablet_copy_client.cc:783] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:33.769562 20975 tablet_copy_client.cc:647] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:33.772612 20975 tablet_copy_client.cc:523] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:33.772722 20990 tablet_copy_client.cc:308] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.1:46599
I20240502 14:17:33.773428 20307 tablet_copy_service.cc:140] P 14e6d73ccbc9463cbc192df0e4d125ac: Received BeginTabletCopySession request for tablet f956dfc843814ccd92546e00110c79ca from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:35946)
I20240502 14:17:33.773540 20307 tablet_copy_service.cc:161] P 14e6d73ccbc9463cbc192df0e4d125ac: Beginning new tablet copy session on tablet f956dfc843814ccd92546e00110c79ca from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:35946: session id = e0f292d80247413b9d1b6ef13fc61aea-f956dfc843814ccd92546e00110c79ca
I20240502 14:17:33.775986 20307 tablet_copy_source_session.cc:205] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:33.776677 20975 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:33.777608 20990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f956dfc843814ccd92546e00110c79ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:33.784612 20990 tablet_copy_client.cc:783] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:33.784698 20975 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:33.785063 20990 tablet_copy_client.cc:647] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:33.785365 20975 tablet_bootstrap.cc:492] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:33.785889 20975 ts_tablet_manager.cc:1367] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.001s
I20240502 14:17:33.786754 20975 raft_consensus.cc:348] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.786962 20975 raft_consensus.cc:729] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:33.787135 20975 consensus_queue.cc:260] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.787556 20990 tablet_copy_client.cc:523] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:33.787825 20975 ts_tablet_manager.cc:1398] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 14:17:33.790009 20307 tablet_copy_service.cc:342] P 14e6d73ccbc9463cbc192df0e4d125ac: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-6d6d7c5a9de147b5b055198c5e6ec28a received from {username='slave'} at 127.0.0.1:35946
I20240502 14:17:33.790171 20307 tablet_copy_service.cc:433] P 14e6d73ccbc9463cbc192df0e4d125ac: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-6d6d7c5a9de147b5b055198c5e6ec28a on tablet 6d6d7c5a9de147b5b055198c5e6ec28a with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:33.791563 20990 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:33.798979 20990 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:33.799465 20990 tablet_bootstrap.cc:492] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:33.799780 20990 ts_tablet_manager.cc:1367] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20240502 14:17:33.800485 20990 raft_consensus.cc:348] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.800772 20990 raft_consensus.cc:729] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:33.800966 20990 consensus_queue.cc:260] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.801508 20990 ts_tablet_manager.cc:1398] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:33.802326 20307 tablet_copy_service.cc:342] P 14e6d73ccbc9463cbc192df0e4d125ac: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-f956dfc843814ccd92546e00110c79ca received from {username='slave'} at 127.0.0.1:35946
I20240502 14:17:33.802421 20307 tablet_copy_service.cc:433] P 14e6d73ccbc9463cbc192df0e4d125ac: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-f956dfc843814ccd92546e00110c79ca on tablet f956dfc843814ccd92546e00110c79ca with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:33.831921 20990 ts_tablet_manager.cc:902] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:33.834182 20990 tablet_copy_client.cc:308] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.2:35997
I20240502 14:17:33.835137 20382 tablet_copy_service.cc:140] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Received BeginTabletCopySession request for tablet adc2243a26fa4068aa4aa7424062292d from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:55850)
I20240502 14:17:33.835319 20382 tablet_copy_service.cc:161] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Beginning new tablet copy session on tablet adc2243a26fa4068aa4aa7424062292d from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:55850: session id = e0f292d80247413b9d1b6ef13fc61aea-adc2243a26fa4068aa4aa7424062292d
I20240502 14:17:33.838212 20382 tablet_copy_source_session.cc:205] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:33.839704 20990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2243a26fa4068aa4aa7424062292d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:33.846900 20990 tablet_copy_client.cc:783] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:33.847301 20990 tablet_copy_client.cc:647] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:33.849682 20990 tablet_copy_client.cc:523] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:33.852986 20990 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:33.860785 20990 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:33.861317 20990 tablet_bootstrap.cc:492] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:33.861621 20990 ts_tablet_manager.cc:1367] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20240502 14:17:33.862447 20990 raft_consensus.cc:348] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.862725 20990 raft_consensus.cc:729] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:33.862980 20990 consensus_queue.cc:260] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:33.863658 20990 ts_tablet_manager.cc:1398] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240502 14:17:33.864578 20382 tablet_copy_service.cc:342] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-adc2243a26fa4068aa4aa7424062292d received from {username='slave'} at 127.0.0.1:55850
I20240502 14:17:33.864718 20382 tablet_copy_service.cc:433] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-adc2243a26fa4068aa4aa7424062292d on tablet adc2243a26fa4068aa4aa7424062292d with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:34.153268 20921 raft_consensus.cc:1203] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:34.227537 20921 raft_consensus.cc:1203] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:34.259145 20921 raft_consensus.cc:1203] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:34.384143 20921 raft_consensus.cc:1203] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:34.639842 20500 raft_consensus.cc:1050] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:34.640954 20500 consensus_queue.cc:237] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.643693 20921 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.644357 20500 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.644610 20293 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.645125 20444 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.645292 21002 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.645764 20500 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.650421 21002 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.651362 20293 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.654670 20921 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.657213 20192 catalog_manager.cc:5484] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:34.670707 20442 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.682140 20370 consensus_queue.cc:237] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.684435 20921 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.684721 20442 raft_consensus.cc:1261] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.685070 20500 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.685561 21002 consensus_queue.cc:1035] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.688803 21002 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.689543 20921 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.690833 20442 raft_consensus.cc:2932] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.693943 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 449e6e4e1a274922aa9bf52b2ce7d025 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:34.696429 20194 catalog_manager.cc:5484] T 449e6e4e1a274922aa9bf52b2ce7d025 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.705545 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet 449e6e4e1a274922aa9bf52b2ce7d025 with delete_type TABLET_DATA_TOMBSTONED (TS 14e6d73ccbc9463cbc192df0e4d125ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35918
I20240502 14:17:34.706935 21012 tablet_replica.cc:330] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: stopping tablet replica
I20240502 14:17:34.707199 21012 raft_consensus.cc:2229] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:34.708021 21012 raft_consensus.cc:2258] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:34.709067 21012 ts_tablet_manager.cc:1875] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:34.716212 21012 ts_tablet_manager.cc:1888] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:34.716392 21012 log.cc:1196] T 449e6e4e1a274922aa9bf52b2ce7d025 P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root/wals/449e6e4e1a274922aa9bf52b2ce7d025
I20240502 14:17:34.717149 20180 catalog_manager.cc:4830] TS 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): tablet 449e6e4e1a274922aa9bf52b2ce7d025 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:34.826604 21002 raft_consensus.cc:1050] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:34.827369 21002 consensus_queue.cc:237] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.830228 20297 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.830299 20442 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.830791 20921 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.830803 20621 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.831386 20621 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.831881 20621 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.846323 20566 raft_consensus.cc:1050] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:34.847932 20566 consensus_queue.cc:237] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.851367 20500 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.852563 20370 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.853880 20920 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.853922 20988 raft_consensus.cc:1050] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:34.854302 21019 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.855242 20988 consensus_queue.cc:237] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.858652 20566 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.858456 20444 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.859066 20297 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.864369 20194 catalog_manager.cc:5484] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:34.871901 20920 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.879192 20442 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.879851 20566 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.888648 20920 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.888983 20444 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.890658 20371 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:34.890938 20370 consensus_queue.cc:237] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.891260 20988 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.891863 20988 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.892599 20988 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:34.893646 20919 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.897722 20446 raft_consensus.cc:1261] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.899820 20621 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.900261 20500 consensus_queue.cc:1035] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.906973 21011 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.913381 20919 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.919045 20446 raft_consensus.cc:2932] T adc2243a26fa4068aa4aa7424062292d P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.925459 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet adc2243a26fa4068aa4aa7424062292d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:34.928754 20195 catalog_manager.cc:5484] T adc2243a26fa4068aa4aa7424062292d P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:34.939602 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2243a26fa4068aa4aa7424062292d with delete_type TABLET_DATA_TOMBSTONED (TS 14e6d73ccbc9463cbc192df0e4d125ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35918
I20240502 14:17:34.940019 21012 tablet_replica.cc:330] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: stopping tablet replica
I20240502 14:17:34.940263 21012 raft_consensus.cc:2229] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:34.940559 21012 raft_consensus.cc:2258] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:34.942759 21012 ts_tablet_manager.cc:1875] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:34.951464 21019 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.954413 20921 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.956581 21012 ts_tablet_manager.cc:1888] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:34.957172 21012 log.cc:1196] T adc2243a26fa4068aa4aa7424062292d P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root/wals/adc2243a26fa4068aa4aa7424062292d
I20240502 14:17:34.957862 20371 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.960695 20194 catalog_manager.cc:5484] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.959255 20442 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.966272 20180 catalog_manager.cc:4830] TS 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): tablet adc2243a26fa4068aa4aa7424062292d (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:34.966082 20566 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.971789 20921 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.975198 20294 consensus_queue.cc:237] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.979683 20195 catalog_manager.cc:5484] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.981781 20442 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.983194 20371 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:34.986342 20444 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.991261 21018 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.993938 20921 raft_consensus.cc:1261] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.993202 20297 consensus_queue.cc:237] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:34.994498 21018 consensus_queue.cc:1035] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.997790 20920 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:34.998610 20566 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:34.998759 21019 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.001431 20370 raft_consensus.cc:1261] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:35.002422 20920 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.004354 20988 consensus_queue.cc:1035] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:35.006358 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6d6d7c5a9de147b5b055198c5e6ec28a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:35.006197 20919 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.009634 20194 catalog_manager.cc:5484] T 6d6d7c5a9de147b5b055198c5e6ec28a P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.005368 20444 raft_consensus.cc:2932] T 6d6d7c5a9de147b5b055198c5e6ec28a P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.005774 20566 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.016650 20356 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6d7c5a9de147b5b055198c5e6ec28a with delete_type TABLET_DATA_TOMBSTONED (TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55812
I20240502 14:17:35.020095 20371 raft_consensus.cc:2932] T f956dfc843814ccd92546e00110c79ca P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.021795 20194 catalog_manager.cc:5484] T f956dfc843814ccd92546e00110c79ca P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:35.027195 20433 tablet_service.cc:1514] Processing DeleteTablet for tablet f956dfc843814ccd92546e00110c79ca with delete_type TABLET_DATA_TOMBSTONED (TS 3d3f7ef2c14146fda4d1dba8a5ac597d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33034
I20240502 14:17:35.033902 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f956dfc843814ccd92546e00110c79ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:35.046734 21029 tablet_replica.cc:330] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: stopping tablet replica
I20240502 14:17:35.047060 21029 raft_consensus.cc:2229] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:35.047420 21029 raft_consensus.cc:2258] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:35.048784 21029 ts_tablet_manager.cc:1875] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:35.049094 21028 tablet_replica.cc:330] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: stopping tablet replica
I20240502 14:17:35.049626 21028 raft_consensus.cc:2229] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:35.049948 21028 raft_consensus.cc:2258] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:35.050860 21028 ts_tablet_manager.cc:1875] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:35.057138 21028 ts_tablet_manager.cc:1888] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:35.057322 21028 log.cc:1196] T 6d6d7c5a9de147b5b055198c5e6ec28a P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root/wals/6d6d7c5a9de147b5b055198c5e6ec28a
I20240502 14:17:35.058173 20180 catalog_manager.cc:4830] TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): tablet 6d6d7c5a9de147b5b055198c5e6ec28a (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:35.059654 21029 ts_tablet_manager.cc:1888] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:35.059793 21029 log.cc:1196] T f956dfc843814ccd92546e00110c79ca P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root/wals/f956dfc843814ccd92546e00110c79ca
I20240502 14:17:35.060631 20180 catalog_manager.cc:4830] TS 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): tablet f956dfc843814ccd92546e00110c79ca (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:36.059681 20293 consensus_queue.cc:237] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.063114 20369 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:36.063138 20262 consensus_peers.cc:485] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27d675ca2ff64753ae52ae207d7d9dc9. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:36.063606 20444 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:36.063694 21019 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.065043 21021 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.067395 21021 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.068410 20369 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.069574 20442 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.076099 20194 catalog_manager.cc:5484] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.080860 20369 consensus_queue.cc:237] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.083742 20442 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:36.084036 20293 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:36.084059 20337 consensus_peers.cc:485] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 079e05082c0c4434a4dcabafa01bfba9. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:36.084367 21002 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.084717 21011 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.092424 21002 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.094458 20442 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.095168 20293 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.101766 20194 catalog_manager.cc:5484] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.103211 20297 consensus_queue.cc:237] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.107339 20371 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:36.107326 20262 consensus_peers.cc:485] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05eba15f48eb4ff4b1b87d7f36b186a5. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:36.107339 20442 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:36.108412 21019 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.108800 21021 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.113333 21021 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.114320 20371 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.119984 20442 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.120751 20297 consensus_queue.cc:237] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.120853 20195 catalog_manager.cc:5484] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.123661 20371 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:36.125444 20262 consensus_peers.cc:485] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 258d15b6ad4e4416b745eeed7cb3c757. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:36.125527 21037 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.127260 20442 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:36.127841 21037 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:36.130972 21019 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.132388 20369 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.137166 20444 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:36.138044 20192 catalog_manager.cc:5484] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:36.496709 21051 ts_tablet_manager.cc:902] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:36.498772 21051 tablet_copy_client.cc:308] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.1:46599
I20240502 14:17:36.499604 20307 tablet_copy_service.cc:140] P 14e6d73ccbc9463cbc192df0e4d125ac: Received BeginTabletCopySession request for tablet 27d675ca2ff64753ae52ae207d7d9dc9 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:35946)
I20240502 14:17:36.499783 20307 tablet_copy_service.cc:161] P 14e6d73ccbc9463cbc192df0e4d125ac: Beginning new tablet copy session on tablet 27d675ca2ff64753ae52ae207d7d9dc9 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:35946: session id = e0f292d80247413b9d1b6ef13fc61aea-27d675ca2ff64753ae52ae207d7d9dc9
I20240502 14:17:36.502357 20307 tablet_copy_source_session.cc:205] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:36.503924 21051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27d675ca2ff64753ae52ae207d7d9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:36.510162 21051 tablet_copy_client.cc:783] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:36.510624 21051 tablet_copy_client.cc:647] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:36.512517 21051 tablet_copy_client.cc:523] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:36.515938 21051 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:36.523303 21051 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:36.523774 21051 tablet_bootstrap.cc:492] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:36.524137 21051 ts_tablet_manager.cc:1367] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20240502 14:17:36.525430 21051 raft_consensus.cc:348] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.525740 21051 raft_consensus.cc:729] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:36.526057 21051 consensus_queue.cc:260] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.527240 21051 ts_tablet_manager.cc:1398] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20240502 14:17:36.528141 20307 tablet_copy_service.cc:342] P 14e6d73ccbc9463cbc192df0e4d125ac: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-27d675ca2ff64753ae52ae207d7d9dc9 received from {username='slave'} at 127.0.0.1:35946
I20240502 14:17:36.528296 20307 tablet_copy_service.cc:433] P 14e6d73ccbc9463cbc192df0e4d125ac: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-27d675ca2ff64753ae52ae207d7d9dc9 on tablet 27d675ca2ff64753ae52ae207d7d9dc9 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:36.540467 21051 ts_tablet_manager.cc:902] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:36.541967 21051 tablet_copy_client.cc:308] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.2:35997
I20240502 14:17:36.542683 20382 tablet_copy_service.cc:140] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Received BeginTabletCopySession request for tablet 079e05082c0c4434a4dcabafa01bfba9 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:55850)
I20240502 14:17:36.542831 20382 tablet_copy_service.cc:161] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Beginning new tablet copy session on tablet 079e05082c0c4434a4dcabafa01bfba9 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:55850: session id = e0f292d80247413b9d1b6ef13fc61aea-079e05082c0c4434a4dcabafa01bfba9
I20240502 14:17:36.546435 20382 tablet_copy_source_session.cc:205] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:36.547941 21051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 079e05082c0c4434a4dcabafa01bfba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:36.554273 21051 tablet_copy_client.cc:783] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:36.554597 21051 tablet_copy_client.cc:647] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:36.556552 21051 tablet_copy_client.cc:523] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:36.559815 21051 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:36.568900 21051 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:36.569306 21051 tablet_bootstrap.cc:492] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:36.569553 21051 ts_tablet_manager.cc:1367] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20240502 14:17:36.570233 21051 raft_consensus.cc:348] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.570430 21051 raft_consensus.cc:729] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:36.570622 21051 consensus_queue.cc:260] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.571178 21051 ts_tablet_manager.cc:1398] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 14:17:36.571897 20382 tablet_copy_service.cc:342] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-079e05082c0c4434a4dcabafa01bfba9 received from {username='slave'} at 127.0.0.1:55850
I20240502 14:17:36.572028 20382 tablet_copy_service.cc:433] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-079e05082c0c4434a4dcabafa01bfba9 on tablet 079e05082c0c4434a4dcabafa01bfba9 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:36.593086 21051 ts_tablet_manager.cc:902] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:36.595062 21051 tablet_copy_client.cc:308] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.1:46599
I20240502 14:17:36.595726 20307 tablet_copy_service.cc:140] P 14e6d73ccbc9463cbc192df0e4d125ac: Received BeginTabletCopySession request for tablet 258d15b6ad4e4416b745eeed7cb3c757 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:35946)
I20240502 14:17:36.595898 20307 tablet_copy_service.cc:161] P 14e6d73ccbc9463cbc192df0e4d125ac: Beginning new tablet copy session on tablet 258d15b6ad4e4416b745eeed7cb3c757 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:35946: session id = e0f292d80247413b9d1b6ef13fc61aea-258d15b6ad4e4416b745eeed7cb3c757
I20240502 14:17:36.598254 20307 tablet_copy_source_session.cc:205] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:36.599825 21051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 258d15b6ad4e4416b745eeed7cb3c757. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:36.606087 21051 tablet_copy_client.cc:783] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:36.606740 21051 tablet_copy_client.cc:647] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:36.608398 21051 tablet_copy_client.cc:523] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:36.612236 21051 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:36.619052 21051 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:36.619462 21051 tablet_bootstrap.cc:492] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:36.619702 21051 ts_tablet_manager.cc:1367] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240502 14:17:36.620615 21051 raft_consensus.cc:348] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.620862 21051 raft_consensus.cc:729] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:36.621071 21051 consensus_queue.cc:260] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.621790 21051 ts_tablet_manager.cc:1398] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:36.622583 20307 tablet_copy_service.cc:342] P 14e6d73ccbc9463cbc192df0e4d125ac: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-258d15b6ad4e4416b745eeed7cb3c757 received from {username='slave'} at 127.0.0.1:35946
I20240502 14:17:36.622727 20307 tablet_copy_service.cc:433] P 14e6d73ccbc9463cbc192df0e4d125ac: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-258d15b6ad4e4416b745eeed7cb3c757 on tablet 258d15b6ad4e4416b745eeed7cb3c757 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:36.642850 21051 ts_tablet_manager.cc:902] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:36.645053 21051 tablet_copy_client.cc:308] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.1:46599
I20240502 14:17:36.645783 20307 tablet_copy_service.cc:140] P 14e6d73ccbc9463cbc192df0e4d125ac: Received BeginTabletCopySession request for tablet 05eba15f48eb4ff4b1b87d7f36b186a5 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:35946)
I20240502 14:17:36.645926 20307 tablet_copy_service.cc:161] P 14e6d73ccbc9463cbc192df0e4d125ac: Beginning new tablet copy session on tablet 05eba15f48eb4ff4b1b87d7f36b186a5 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:35946: session id = e0f292d80247413b9d1b6ef13fc61aea-05eba15f48eb4ff4b1b87d7f36b186a5
I20240502 14:17:36.648219 20307 tablet_copy_source_session.cc:205] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:36.649516 21051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05eba15f48eb4ff4b1b87d7f36b186a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:36.656157 21051 tablet_copy_client.cc:783] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:36.656421 21051 tablet_copy_client.cc:647] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:36.658277 21051 tablet_copy_client.cc:523] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:36.661114 21051 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:36.667246 21051 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:36.667622 21051 tablet_bootstrap.cc:492] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:36.667860 21051 ts_tablet_manager.cc:1367] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.003s
I20240502 14:17:36.668599 21051 raft_consensus.cc:348] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.668820 21051 raft_consensus.cc:729] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:36.669001 21051 consensus_queue.cc:260] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:36.669581 21051 ts_tablet_manager.cc:1398] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 14:17:36.670430 20307 tablet_copy_service.cc:342] P 14e6d73ccbc9463cbc192df0e4d125ac: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-05eba15f48eb4ff4b1b87d7f36b186a5 received from {username='slave'} at 127.0.0.1:35946
I20240502 14:17:36.670590 20307 tablet_copy_service.cc:433] P 14e6d73ccbc9463cbc192df0e4d125ac: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-05eba15f48eb4ff4b1b87d7f36b186a5 on tablet 05eba15f48eb4ff4b1b87d7f36b186a5 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:36.991053 20919 raft_consensus.cc:1203] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:37.064698 20919 raft_consensus.cc:1203] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:37.163295 20919 raft_consensus.cc:1203] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:37.199941 20919 raft_consensus.cc:1203] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:37.518469 21073 raft_consensus.cc:1050] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:37.519383 21073 consensus_queue.cc:237] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.521924 20442 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.522033 20371 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.522053 20919 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.522641 21019 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.522943 21037 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.523653 21037 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.530104 21076 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.531049 20370 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.535136 20442 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.540045 20194 catalog_manager.cc:5484] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.544898 20919 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.549108 21002 raft_consensus.cc:1050] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:37.550076 21002 consensus_queue.cc:237] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.555109 20297 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.555047 20919 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.555070 20442 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.555953 21011 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.556030 20293 consensus_queue.cc:237] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.556560 21085 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.557947 20919 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.558717 20444 raft_consensus.cc:1261] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.559865 21037 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.560104 21085 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.561502 21037 raft_consensus.cc:1050] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:37.562491 21037 consensus_queue.cc:237] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.564848 21073 consensus_queue.cc:1035] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.566313 20920 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.567329 21019 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.568110 21076 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.568270 21002 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.569011 20919 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.569756 20371 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.570312 21019 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.571755 20920 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.575224 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 05eba15f48eb4ff4b1b87d7f36b186a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:37.576328 20192 catalog_manager.cc:5484] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:37.580231 20195 catalog_manager.cc:5484] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.580603 20444 raft_consensus.cc:2932] T 05eba15f48eb4ff4b1b87d7f36b186a5 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.585208 20446 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.587064 20356 tablet_service.cc:1514] Processing DeleteTablet for tablet 05eba15f48eb4ff4b1b87d7f36b186a5 with delete_type TABLET_DATA_TOMBSTONED (TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55812
I20240502 14:17:37.587913 21092 tablet_replica.cc:330] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: stopping tablet replica
I20240502 14:17:37.588014 20442 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.588168 21092 raft_consensus.cc:2229] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:37.588500 21092 raft_consensus.cc:2258] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:37.590790 21092 ts_tablet_manager.cc:1875] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:37.590906 21073 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.597929 20297 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.601691 21092 ts_tablet_manager.cc:1888] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:37.601845 21092 log.cc:1196] T 05eba15f48eb4ff4b1b87d7f36b186a5 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root/wals/05eba15f48eb4ff4b1b87d7f36b186a5
I20240502 14:17:37.602871 21019 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.604367 20180 catalog_manager.cc:4830] TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): tablet 05eba15f48eb4ff4b1b87d7f36b186a5 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:37.606878 20370 consensus_queue.cc:237] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.609150 20920 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.611050 20921 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.612370 20371 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.611037 20294 raft_consensus.cc:1261] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.614619 21085 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.614552 20444 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.615887 21085 consensus_queue.cc:1035] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.617962 21002 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.617897 20192 catalog_manager.cc:5484] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:37.619207 20921 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.621361 20297 raft_consensus.cc:2932] T 079e05082c0c4434a4dcabafa01bfba9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.625087 20194 catalog_manager.cc:5484] T 079e05082c0c4434a4dcabafa01bfba9 P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.626693 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 079e05082c0c4434a4dcabafa01bfba9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:37.631283 20433 tablet_service.cc:1514] Processing DeleteTablet for tablet 079e05082c0c4434a4dcabafa01bfba9 with delete_type TABLET_DATA_TOMBSTONED (TS 3d3f7ef2c14146fda4d1dba8a5ac597d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33034
I20240502 14:17:37.632205 21096 tablet_replica.cc:330] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: stopping tablet replica
I20240502 14:17:37.632541 21096 raft_consensus.cc:2229] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:37.632716 20297 consensus_queue.cc:237] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.632894 21096 raft_consensus.cc:2258] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:37.633935 21096 ts_tablet_manager.cc:1875] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:37.639693 20446 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.643153 21037 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.645391 21096 ts_tablet_manager.cc:1888] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:37.645587 21096 log.cc:1196] T 079e05082c0c4434a4dcabafa01bfba9 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root/wals/079e05082c0c4434a4dcabafa01bfba9
I20240502 14:17:37.646911 20180 catalog_manager.cc:4830] TS 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): tablet 079e05082c0c4434a4dcabafa01bfba9 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:37.648236 20921 raft_consensus.cc:1261] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.649914 21037 consensus_queue.cc:1035] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.650321 21019 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.651866 20921 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.652288 20444 raft_consensus.cc:2932] T 27d675ca2ff64753ae52ae207d7d9dc9 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.654817 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 27d675ca2ff64753ae52ae207d7d9dc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:37.657855 20192 catalog_manager.cc:5484] T 27d675ca2ff64753ae52ae207d7d9dc9 P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.662242 20356 tablet_service.cc:1514] Processing DeleteTablet for tablet 27d675ca2ff64753ae52ae207d7d9dc9 with delete_type TABLET_DATA_TOMBSTONED (TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55812
I20240502 14:17:37.663740 21092 tablet_replica.cc:330] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: stopping tablet replica
I20240502 14:17:37.664014 21092 raft_consensus.cc:2229] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:37.664324 21092 raft_consensus.cc:2258] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:37.665500 21092 ts_tablet_manager.cc:1875] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:37.672243 21092 ts_tablet_manager.cc:1888] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:37.672389 21092 log.cc:1196] T 27d675ca2ff64753ae52ae207d7d9dc9 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root/wals/27d675ca2ff64753ae52ae207d7d9dc9
I20240502 14:17:37.673063 20180 catalog_manager.cc:4830] TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): tablet 27d675ca2ff64753ae52ae207d7d9dc9 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:37.750197 21095 raft_consensus.cc:1050] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:37.751163 21095 consensus_queue.cc:237] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.754101 20371 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.754135 20921 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.754135 20444 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:37.754817 21037 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.755280 21019 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.755745 21095 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:37.764853 21037 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.767670 20371 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.769788 20444 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.773981 20194 catalog_manager.cc:5484] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:37.775352 20921 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.781513 20297 consensus_queue.cc:237] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:37.784106 20371 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.785089 20921 raft_consensus.cc:1261] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:37.785076 21095 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:37.785787 21037 consensus_queue.cc:1035] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20240502 14:17:37.788954 21019 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.792109 20370 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.794059 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 258d15b6ad4e4416b745eeed7cb3c757 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:37.791131 20921 raft_consensus.cc:2932] T 258d15b6ad4e4416b745eeed7cb3c757 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:37.798106 20195 catalog_manager.cc:5484] T 258d15b6ad4e4416b745eeed7cb3c757 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:37.806751 20433 tablet_service.cc:1514] Processing DeleteTablet for tablet 258d15b6ad4e4416b745eeed7cb3c757 with delete_type TABLET_DATA_TOMBSTONED (TS 3d3f7ef2c14146fda4d1dba8a5ac597d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33034
I20240502 14:17:37.807183 21096 tablet_replica.cc:330] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: stopping tablet replica
I20240502 14:17:37.807418 21096 raft_consensus.cc:2229] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:37.807718 21096 raft_consensus.cc:2258] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:37.808701 21096 ts_tablet_manager.cc:1875] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:37.813856 21096 ts_tablet_manager.cc:1888] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:37.814010 21096 log.cc:1196] T 258d15b6ad4e4416b745eeed7cb3c757 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root/wals/258d15b6ad4e4416b745eeed7cb3c757
I20240502 14:17:37.814864 20180 catalog_manager.cc:4830] TS 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): tablet 258d15b6ad4e4416b745eeed7cb3c757 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:38.832409 20444 consensus_queue.cc:237] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:38.835641 20371 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:38.835644 20297 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:38.836767 21088 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.837567 21104 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.840837 21088 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.841753 20297 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
W20240502 14:17:38.845008 20411 consensus_peers.cc:485] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daf758a9a8314106bcb1ed7abb8cc220. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:38.846982 20371 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.847646 20370 consensus_queue.cc:237] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:38.851397 20194 catalog_manager.cc:5484] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:38.852972 20297 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:38.853686 20337 consensus_peers.cc:485] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c80067ebc4504518a6429c342c100642. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:38.854135 21002 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.854444 20444 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:38.857631 21002 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.859527 21002 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.860435 20297 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.865917 20446 consensus_queue.cc:237] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:38.870113 20371 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:38.870779 20411 consensus_peers.cc:485] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e989cc9924b04f018e332d78582556f1. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:38.871371 21030 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.872694 20297 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:38.873289 21030 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.882702 21088 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.891609 20294 consensus_queue.cc:237] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:38.898931 20370 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:38.897914 20297 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
W20240502 14:17:38.899724 20262 consensus_peers.cc:485] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb046706fc504c47870d1f084489befe. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:38.899816 21076 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.901448 20446 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:38.902062 21076 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:38.903960 20443 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.904289 20371 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.911598 20446 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.911360 21122 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.914863 20195 catalog_manager.cc:5484] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.915493 20195 catalog_manager.cc:5484] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:38.911366 20370 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:38.925783 20194 catalog_manager.cc:5484] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:39.376058 21126 ts_tablet_manager.cc:902] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:39.378939 21126 tablet_copy_client.cc:308] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.3:42527
I20240502 14:17:39.388154 20456 tablet_copy_service.cc:140] P 3d3f7ef2c14146fda4d1dba8a5ac597d: Received BeginTabletCopySession request for tablet e989cc9924b04f018e332d78582556f1 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:40538)
I20240502 14:17:39.388340 20456 tablet_copy_service.cc:161] P 3d3f7ef2c14146fda4d1dba8a5ac597d: Beginning new tablet copy session on tablet e989cc9924b04f018e332d78582556f1 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:40538: session id = e0f292d80247413b9d1b6ef13fc61aea-e989cc9924b04f018e332d78582556f1
I20240502 14:17:39.391403 20456 tablet_copy_source_session.cc:205] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:39.392786 21126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e989cc9924b04f018e332d78582556f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:39.398285 21126 tablet_copy_client.cc:783] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:39.398567 21126 tablet_copy_client.cc:647] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:39.400280 21126 tablet_copy_client.cc:523] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:39.403388 21126 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:39.410215 21126 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:39.410729 21126 tablet_bootstrap.cc:492] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:39.411018 21126 ts_tablet_manager.cc:1367] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.001s
I20240502 14:17:39.411948 21126 raft_consensus.cc:348] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.412235 21126 raft_consensus.cc:729] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:39.412473 21126 consensus_queue.cc:260] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.413524 21126 ts_tablet_manager.cc:1398] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240502 14:17:39.414404 20456 tablet_copy_service.cc:342] P 3d3f7ef2c14146fda4d1dba8a5ac597d: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-e989cc9924b04f018e332d78582556f1 received from {username='slave'} at 127.0.0.1:40538
I20240502 14:17:39.414520 20456 tablet_copy_service.cc:433] P 3d3f7ef2c14146fda4d1dba8a5ac597d: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-e989cc9924b04f018e332d78582556f1 on tablet e989cc9924b04f018e332d78582556f1 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:39.418135 21126 ts_tablet_manager.cc:902] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
I20240502 14:17:39.420650 21126 tablet_copy_client.cc:308] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.1:46599
I20240502 14:17:39.421463 20307 tablet_copy_service.cc:140] P 14e6d73ccbc9463cbc192df0e4d125ac: Received BeginTabletCopySession request for tablet fb046706fc504c47870d1f084489befe from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:35946)
I20240502 14:17:39.421624 20307 tablet_copy_service.cc:161] P 14e6d73ccbc9463cbc192df0e4d125ac: Beginning new tablet copy session on tablet fb046706fc504c47870d1f084489befe from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:35946: session id = e0f292d80247413b9d1b6ef13fc61aea-fb046706fc504c47870d1f084489befe
I20240502 14:17:39.424422 20307 tablet_copy_source_session.cc:205] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:39.425881 21126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb046706fc504c47870d1f084489befe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:39.429127 21139 ts_tablet_manager.cc:902] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527)
I20240502 14:17:39.432214 21139 tablet_copy_client.cc:308] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.3:42527
I20240502 14:17:39.433025 20456 tablet_copy_service.cc:140] P 3d3f7ef2c14146fda4d1dba8a5ac597d: Received BeginTabletCopySession request for tablet daf758a9a8314106bcb1ed7abb8cc220 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:40538)
I20240502 14:17:39.433193 20456 tablet_copy_service.cc:161] P 3d3f7ef2c14146fda4d1dba8a5ac597d: Beginning new tablet copy session on tablet daf758a9a8314106bcb1ed7abb8cc220 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:40538: session id = e0f292d80247413b9d1b6ef13fc61aea-daf758a9a8314106bcb1ed7abb8cc220
I20240502 14:17:39.433537 21126 tablet_copy_client.cc:783] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:39.433775 21126 tablet_copy_client.cc:647] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:39.436034 20456 tablet_copy_source_session.cc:205] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:39.436298 21126 tablet_copy_client.cc:523] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:39.437634 21139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet daf758a9a8314106bcb1ed7abb8cc220. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:39.441354 21144 ts_tablet_manager.cc:902] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
I20240502 14:17:39.444406 21139 tablet_copy_client.cc:783] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:39.444849 21139 tablet_copy_client.cc:647] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:39.446743 21139 tablet_copy_client.cc:523] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:39.447116 21126 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:39.450729 21139 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:39.460872 21144 tablet_copy_client.cc:308] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Beginning tablet copy session from remote peer at address 127.18.176.2:35997
I20240502 14:17:39.461750 20382 tablet_copy_service.cc:140] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Received BeginTabletCopySession request for tablet c80067ebc4504518a6429c342c100642 from peer e0f292d80247413b9d1b6ef13fc61aea ({username='slave'} at 127.0.0.1:55850)
I20240502 14:17:39.461963 20382 tablet_copy_service.cc:161] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Beginning new tablet copy session on tablet c80067ebc4504518a6429c342c100642 from peer e0f292d80247413b9d1b6ef13fc61aea at {username='slave'} at 127.0.0.1:55850: session id = e0f292d80247413b9d1b6ef13fc61aea-c80067ebc4504518a6429c342c100642
I20240502 14:17:39.464793 21139 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:39.465096 20382 tablet_copy_source_session.cc:205] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 14:17:39.465395 21126 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:39.465499 21139 tablet_bootstrap.cc:492] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:39.465826 21139 ts_tablet_manager.cc:1367] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20240502 14:17:39.466411 21144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c80067ebc4504518a6429c342c100642. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 14:17:39.466861 21139 raft_consensus.cc:348] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.467114 21139 raft_consensus.cc:729] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:39.467720 21126 tablet_bootstrap.cc:492] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:39.468006 21126 ts_tablet_manager.cc:1367] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.010s
I20240502 14:17:39.468851 21126 raft_consensus.cc:348] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.469101 21126 raft_consensus.cc:729] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:39.469333 21126 consensus_queue.cc:260] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.470644 21126 ts_tablet_manager.cc:1398] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240502 14:17:39.474315 20307 tablet_copy_service.cc:342] P 14e6d73ccbc9463cbc192df0e4d125ac: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-fb046706fc504c47870d1f084489befe received from {username='slave'} at 127.0.0.1:35946
I20240502 14:17:39.474467 20307 tablet_copy_service.cc:433] P 14e6d73ccbc9463cbc192df0e4d125ac: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-fb046706fc504c47870d1f084489befe on tablet fb046706fc504c47870d1f084489befe with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:39.474793 21144 tablet_copy_client.cc:783] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 0 data blocks...
I20240502 14:17:39.475014 21144 tablet_copy_client.cc:647] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Starting download of 1 WAL segments...
I20240502 14:17:39.467317 21139 consensus_queue.cc:260] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.475767 21139 ts_tablet_manager.cc:1398] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20240502 14:17:39.476450 20456 tablet_copy_service.cc:342] P 3d3f7ef2c14146fda4d1dba8a5ac597d: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-daf758a9a8314106bcb1ed7abb8cc220 received from {username='slave'} at 127.0.0.1:40538
I20240502 14:17:39.476598 20456 tablet_copy_service.cc:433] P 3d3f7ef2c14146fda4d1dba8a5ac597d: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-daf758a9a8314106bcb1ed7abb8cc220 on tablet daf758a9a8314106bcb1ed7abb8cc220 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:39.478783 21144 tablet_copy_client.cc:523] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 14:17:39.482831 21144 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap starting.
I20240502 14:17:39.489717 21144 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 14:17:39.490140 21144 tablet_bootstrap.cc:492] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: Bootstrap complete.
I20240502 14:17:39.490402 21144 ts_tablet_manager.cc:1367] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20240502 14:17:39.491365 21144 raft_consensus.cc:348] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.491575 21144 raft_consensus.cc:729] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e0f292d80247413b9d1b6ef13fc61aea, State: Initialized, Role: LEARNER
I20240502 14:17:39.491761 21144 consensus_queue.cc:260] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:39.493176 21144 ts_tablet_manager.cc:1398] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240502 14:17:39.493865 20382 tablet_copy_service.cc:342] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Request end of tablet copy session e0f292d80247413b9d1b6ef13fc61aea-c80067ebc4504518a6429c342c100642 received from {username='slave'} at 127.0.0.1:55850
I20240502 14:17:39.493963 20382 tablet_copy_service.cc:433] P cb48b1aadcdc4b5b9ebfd1375b7bcb63: ending tablet copy session e0f292d80247413b9d1b6ef13fc61aea-c80067ebc4504518a6429c342c100642 on tablet c80067ebc4504518a6429c342c100642 with peer e0f292d80247413b9d1b6ef13fc61aea
I20240502 14:17:39.813875 20920 raft_consensus.cc:1203] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:39.820933 20920 raft_consensus.cc:1203] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:39.838059 20920 raft_consensus.cc:1203] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:39.957752 20920 raft_consensus.cc:1203] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 14:17:40.260424 21076 raft_consensus.cc:1050] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:40.261217 21076 consensus_queue.cc:237] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.268008 20920 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.268930 21122 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.270186 20443 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.270318 20370 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.270766 21152 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.271111 21122 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.274498 21122 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.276065 20370 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.279039 20444 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.281589 20195 catalog_manager.cc:5484] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:40.283030 20920 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.287312 21120 raft_consensus.cc:1050] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:40.288273 21120 consensus_queue.cc:237] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.296319 21153 raft_consensus.cc:1050] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:40.297425 21153 consensus_queue.cc:237] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.300940 20920 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.301851 21030 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.303102 20370 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.303544 20293 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.304004 21030 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.304359 21154 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.309237 20444 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.309618 20921 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.310410 21002 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.311151 21002 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.312556 20297 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.313226 21002 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.338085 21002 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.340152 21030 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.340938 20920 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.344297 20297 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.346887 20193 catalog_manager.cc:5484] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:40.347184 20370 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.351615 20194 catalog_manager.cc:5484] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.351917 20921 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.352952 20370 consensus_queue.cc:237] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.357730 20921 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.357765 20297 raft_consensus.cc:1261] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.358369 21002 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.358381 20446 consensus_queue.cc:237] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.361079 21153 consensus_queue.cc:1035] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.361390 20920 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.355199 20293 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.361603 21153 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.365250 21030 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.366793 20921 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.368384 20297 consensus_queue.cc:237] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.371034 21154 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.371685 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet c80067ebc4504518a6429c342c100642 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:40.375222 20195 catalog_manager.cc:5484] T c80067ebc4504518a6429c342c100642 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:40.376339 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet daf758a9a8314106bcb1ed7abb8cc220 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:40.376116 20921 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.376108 20293 raft_consensus.cc:2932] T c80067ebc4504518a6429c342c100642 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.379833 20446 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.379645 20192 catalog_manager.cc:5484] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:40.380920 21122 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.382288 20371 raft_consensus.cc:1261] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.383539 21120 consensus_queue.cc:1035] T daf758a9a8314106bcb1ed7abb8cc220 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.386440 20920 raft_consensus.cc:1261] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.388149 20370 raft_consensus.cc:2932] T daf758a9a8314106bcb1ed7abb8cc220 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.392176 20433 tablet_service.cc:1514] Processing DeleteTablet for tablet c80067ebc4504518a6429c342c100642 with delete_type TABLET_DATA_TOMBSTONED (TS 3d3f7ef2c14146fda4d1dba8a5ac597d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33034
I20240502 14:17:40.393213 21174 tablet_replica.cc:330] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: stopping tablet replica
I20240502 14:17:40.393515 21174 raft_consensus.cc:2229] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:40.393816 21174 pending_rounds.cc:62] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Trying to abort 1 pending ops.
I20240502 14:17:40.393846 21076 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.394109 21174 pending_rounds.cc:68] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7023245149375684608 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c80067ebc4504518a6429c342c100642" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } } }
I20240502 14:17:40.394848 21174 raft_consensus.cc:2894] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20240502 14:17:40.395031 21174 raft_consensus.cc:2866] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 14:17:40.395159 21174 raft_consensus.cc:2258] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:40.396374 21122 consensus_queue.cc:1035] T fb046706fc504c47870d1f084489befe P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.396564 21174 ts_tablet_manager.cc:1875] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:40.398828 20444 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.402577 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet daf758a9a8314106bcb1ed7abb8cc220 with delete_type TABLET_DATA_TOMBSTONED (TS 14e6d73ccbc9463cbc192df0e4d125ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35918
I20240502 14:17:40.407131 20920 raft_consensus.cc:2932] T fb046706fc504c47870d1f084489befe P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.419514 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fb046706fc504c47870d1f084489befe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:40.421670 20192 catalog_manager.cc:5484] T fb046706fc504c47870d1f084489befe P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index 3 to 4, VOTER cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2) evicted. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.429176 20356 tablet_service.cc:1514] Processing DeleteTablet for tablet fb046706fc504c47870d1f084489befe with delete_type TABLET_DATA_TOMBSTONED (TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55812
I20240502 14:17:40.430351 21176 tablet_replica.cc:330] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: stopping tablet replica
I20240502 14:17:40.430660 21176 raft_consensus.cc:2229] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:40.431154 21176 raft_consensus.cc:2258] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:40.432096 21175 tablet_replica.cc:330] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: stopping tablet replica
I20240502 14:17:40.432776 21176 ts_tablet_manager.cc:1875] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:40.432807 21175 raft_consensus.cc:2229] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:40.433162 21175 raft_consensus.cc:2258] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:40.434904 21175 ts_tablet_manager.cc:1875] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:40.440055 21176 ts_tablet_manager.cc:1888] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:40.440220 21176 log.cc:1196] T fb046706fc504c47870d1f084489befe P cb48b1aadcdc4b5b9ebfd1375b7bcb63: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-1-root/wals/fb046706fc504c47870d1f084489befe
I20240502 14:17:40.441072 20180 catalog_manager.cc:4830] TS cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997): tablet fb046706fc504c47870d1f084489befe (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:40.441710 21175 ts_tablet_manager.cc:1888] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:40.441850 21175 log.cc:1196] T daf758a9a8314106bcb1ed7abb8cc220 P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root/wals/daf758a9a8314106bcb1ed7abb8cc220
I20240502 14:17:40.434087 21174 ts_tablet_manager.cc:1888] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:40.442688 21174 log.cc:1196] T c80067ebc4504518a6429c342c100642 P 3d3f7ef2c14146fda4d1dba8a5ac597d: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-2-root/wals/c80067ebc4504518a6429c342c100642
I20240502 14:17:40.442685 20180 catalog_manager.cc:4830] TS 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): tablet daf758a9a8314106bcb1ed7abb8cc220 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:40.443486 20180 catalog_manager.cc:4830] TS 3d3f7ef2c14146fda4d1dba8a5ac597d (127.18.176.3:42527): tablet c80067ebc4504518a6429c342c100642 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:40.526980 21120 raft_consensus.cc:1050] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d: attempting to promote NON_VOTER e0f292d80247413b9d1b6ef13fc61aea to VOTER
I20240502 14:17:40.527910 21120 consensus_queue.cc:237] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.530488 20920 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 LEARNER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.531018 20371 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.531334 20294 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 14:17:40.531477 21030 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.532958 21154 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.533543 21154 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 14:17:40.546144 21030 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.552481 20294 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.553084 20920 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.554693 20371 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.555719 20194 catalog_manager.cc:5484] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d reported cstate change: config changed from index 2 to 3, e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 14:17:40.570011 20444 consensus_queue.cc:237] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } }
I20240502 14:17:40.571949 20920 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.572183 20371 raft_consensus.cc:1261] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 3d3f7ef2c14146fda4d1dba8a5ac597d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 14:17:40.572579 21030 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.572973 21154 consensus_queue.cc:1035] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 14:17:40.576862 20370 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.576989 20920 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.578877 21154 raft_consensus.cc:2932] T e989cc9924b04f018e332d78582556f1 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.583050 20192 catalog_manager.cc:5484] T e989cc9924b04f018e332d78582556f1 P e0f292d80247413b9d1b6ef13fc61aea reported cstate change: config changed from index 3 to 4, VOTER 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1) evicted. New cstate: current_term: 1 leader_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: false } } }
I20240502 14:17:40.585337 20180 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e989cc9924b04f018e332d78582556f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 14:17:40.590718 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet e989cc9924b04f018e332d78582556f1 with delete_type TABLET_DATA_TOMBSTONED (TS 14e6d73ccbc9463cbc192df0e4d125ac not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35918
I20240502 14:17:40.591080 21175 tablet_replica.cc:330] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: stopping tablet replica
I20240502 14:17:40.591279 21175 raft_consensus.cc:2229] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 14:17:40.591497 21175 raft_consensus.cc:2258] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 14:17:40.592409 21175 ts_tablet_manager.cc:1875] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 14:17:40.598692 21175 ts_tablet_manager.cc:1888] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 14:17:40.598857 21175 log.cc:1196] T e989cc9924b04f018e332d78582556f1 P 14e6d73ccbc9463cbc192df0e4d125ac: Deleting WAL directory at /tmp/dist-test-taskfr6E80/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714659390546060-19136-0/minicluster-data/ts-0-root/wals/e989cc9924b04f018e332d78582556f1
I20240502 14:17:40.599601 20180 catalog_manager.cc:4830] TS 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599): tablet e989cc9924b04f018e332d78582556f1 (table test-workload [id=cb60678755a14f70a88f1910a3b63182]) successfully deleted
I20240502 14:17:41.608007 20370 consensus_queue.cc:237] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
W20240502 14:17:41.611186 20337 consensus_peers.cc:485] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f88bd39a1f614d9987a0f306980b19d7. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:41.611236 20294 raft_consensus.cc:1261] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:41.611353 20446 raft_consensus.cc:1261] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:41.611809 21002 consensus_queue.cc:1035] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.612145 21119 consensus_queue.cc:1035] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.615468 21119 raft_consensus.cc:2932] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.616348 20446 raft_consensus.cc:2932] T f88bd39a1f614d9987a0f306980b19d7 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.619956 20294 raft_consensus.cc:2932] T f88bd39a1f614d9987a0f306980b19d7 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.621515 20192 catalog_manager.cc:5484] T f88bd39a1f614d9987a0f306980b19d7 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:41.623504 20293 consensus_queue.cc:237] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
W20240502 14:17:41.626853 20262 consensus_peers.cc:485] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45c28c2c6be74c10a33f46e52affd378. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:41.627820 20370 raft_consensus.cc:1261] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:41.627876 20446 raft_consensus.cc:1261] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer 14e6d73ccbc9463cbc192df0e4d125ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:41.628494 21122 consensus_queue.cc:1035] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.628919 21182 consensus_queue.cc:1035] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.632652 21122 raft_consensus.cc:2932] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.633263 20446 raft_consensus.cc:2932] T 45c28c2c6be74c10a33f46e52affd378 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.634294 20370 raft_consensus.cc:2932] T 45c28c2c6be74c10a33f46e52affd378 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.638118 20371 consensus_queue.cc:237] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:41.638633 20195 catalog_manager.cc:5484] T 45c28c2c6be74c10a33f46e52affd378 P 14e6d73ccbc9463cbc192df0e4d125ac reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:41.642026 20293 raft_consensus.cc:1261] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:41.642377 20446 raft_consensus.cc:1261] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:41.642562 20337 consensus_peers.cc:485] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36124283cbed413fb7b7e2ca9bf6e9ed. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:41.642817 21187 consensus_queue.cc:1035] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.643469 21119 consensus_queue.cc:1035] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.649250 21119 raft_consensus.cc:2932] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.650077 20293 raft_consensus.cc:2932] T 36124283cbed413fb7b7e2ca9bf6e9ed P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.655683 20195 catalog_manager.cc:5484] T 36124283cbed413fb7b7e2ca9bf6e9ed P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:41.656633 20370 consensus_queue.cc:237] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } }
I20240502 14:17:41.658118 20446 raft_consensus.cc:2932] T 36124283cbed413fb7b7e2ca9bf6e9ed P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } attrs { replace: true } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.669251 20446 raft_consensus.cc:1261] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 14:17:41.669409 20293 raft_consensus.cc:1261] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Refusing update from remote peer cb48b1aadcdc4b5b9ebfd1375b7bcb63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 14:17:41.669400 20337 consensus_peers.cc:485] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 -> Peer e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4:33345): Couldn't send request to peer e0f292d80247413b9d1b6ef13fc61aea. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17922984561e4a82922c5080dd75e8c3. This is attempt 1: this message will repeat every 5th retry.
I20240502 14:17:41.669860 21187 consensus_queue.cc:1035] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.670214 21119 consensus_queue.cc:1035] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 14:17:41.673218 21187 raft_consensus.cc:2932] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.674592 20293 raft_consensus.cc:2932] T 17922984561e4a82922c5080dd75e8c3 P 14e6d73ccbc9463cbc192df0e4d125ac [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.674827 20446 raft_consensus.cc:2932] T 17922984561e4a82922c5080dd75e8c3 P 3d3f7ef2c14146fda4d1dba8a5ac597d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } } }
I20240502 14:17:41.680565 20192 catalog_manager.cc:5484] T 17922984561e4a82922c5080dd75e8c3 P cb48b1aadcdc4b5b9ebfd1375b7bcb63 reported cstate change: config changed from index -1 to 2, NON_VOTER e0f292d80247413b9d1b6ef13fc61aea (127.18.176.4) added. New cstate: current_term: 1 leader_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14e6d73ccbc9463cbc192df0e4d125ac" member_type: VOTER last_known_addr { host: "127.18.176.1" port: 46599 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb48b1aadcdc4b5b9ebfd1375b7bcb63" member_type: VOTER last_known_addr { host: "127.18.176.2" port: 35997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d3f7ef2c14146fda4d1dba8a5ac597d" member_type: VOTER last_known_addr { host: "127.18.176.3" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f292d80247413b9d1b6ef13fc61aea" member_type: NON_VOTER last_known_addr { host: "127.18.176.4" port: 33345 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 14:17:42.039935 21201 ts_tablet_manager.cc:902] T f88bd39a1f614d9987a0f306980b19d7 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
F20240502 14:17:42.040573 21201 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-05eba15f48eb4ff4b1b87d7f36b186a5.queue_time_us, tablet-download-pool-05eba15f48eb4ff4b1b87d7f36b186a5.queue_time_us) (tablet-download-pool-05eba15f48eb4ff4b1b87d7f36b186a5.run_cpu_time_us, tablet-download-pool-05eba15f48eb4ff4b1b87d7f36b186a5.run_cpu_time_us) (tablet-download-pool-05eba15f48eb4ff4b1b87d7f36b186a5.run_wall_time_us, tablet-download-pool-05eba15f48eb4ff4b1b87d7f36b186a5.run_wall_time_us) (tablet-download-pool-079e05082c0c4434a4dcabafa01bfba9.queue_time_us, tablet-download-pool-079e05082c0c4434a4dcabafa01bfba9.queue_time_us) (tablet-download-pool-079e05082c0c4434a4dcabafa01bfba9.run_cpu_time_us, tablet-download-pool-079e05082c0c4434a4dcabafa01bfba9.run_cpu_time_us) (tablet-download-pool-079e05082c0c4434a4dcabafa01bfba9.run_wall_time_us, tablet-download-pool-079e05082c0c4434a4dcabafa01bfba9.run_wall_time_us) (tablet-download-pool-258d15b6ad4e4416b745eeed7cb3c757.queue_time_us, tablet-download-pool-258d15b6ad4e4416b745eeed7cb3c757.queue_time_us) (tablet-download-pool-258d15b6ad4e4416b745eeed7cb3c757.run_cpu_time_us, tablet-download-pool-258d15b6ad4e4416b745eeed7cb3c757.run_cpu_time_us) (tablet-download-pool-258d15b6ad4e4416b745eeed7cb3c757.run_wall_time_us, tablet-download-pool-258d15b6ad4e4416b745eeed7cb3c757.run_wall_time_us) (tablet-download-pool-27d675ca2ff64753ae52ae207d7d9dc9.queue_time_us, tablet-download-pool-27d675ca2ff64753ae52ae207d7d9dc9.queue_time_us) (tablet-download-pool-27d675ca2ff64753ae52ae207d7d9dc9.run_cpu_time_us, tablet-download-pool-27d675ca2ff64753ae52ae207d7d9dc9.run_cpu_time_us) (tablet-download-pool-27d675ca2ff64753ae52ae207d7d9dc9.run_wall_time_us, tablet-download-pool-27d675ca2ff64753ae52ae207d7d9dc9.run_wall_time_us) (tablet-download-pool-449e6e4e1a274922aa9bf52b2ce7d025.queue_time_us, tablet-download-pool-449e6e4e1a274922aa9bf52b2ce7d025.queue_time_us) (tablet-download-pool-449e6e4e1a274922aa9bf52b2ce7d025.run_cpu_time_us, tablet-download-pool-449e6e4e1a274922aa9bf52b2ce7d025.run_cpu_time_us) (tablet-download-pool-449e6e4e1a274922aa9bf52b2ce7d025.run_wall_time_us, tablet-download-pool-449e6e4e1a274922aa9bf52b2ce7d025.run_wall_time_us) (tablet-download-pool-6d6d7c5a9de147b5b055198c5e6ec28a.queue_time_us, tablet-download-pool-6d6d7c5a9de147b5b055198c5e6ec28a.queue_time_us) (tablet-download-pool-6d6d7c5a9de147b5b055198c5e6ec28a.run_cpu_time_us, tablet-download-pool-6d6d7c5a9de147b5b055198c5e6ec28a.run_cpu_time_us) (tablet-download-pool-6d6d7c5a9de147b5b055198c5e6ec28a.run_wall_time_us, tablet-download-pool-6d6d7c5a9de147b5b055198c5e6ec28a.run_wall_time_us) (tablet-download-pool-adc2243a26fa4068aa4aa7424062292d.queue_time_us, tablet-download-pool-adc2243a26fa4068aa4aa7424062292d.queue_time_us) (tablet-download-pool-adc2243a26fa4068aa4aa7424062292d.run_cpu_time_us, tablet-download-pool-adc2243a26fa4068aa4aa7424062292d.run_cpu_time_us) (tablet-download-pool-adc2243a26fa4068aa4aa7424062292d.run_wall_time_us, tablet-download-pool-adc2243a26fa4068aa4aa7424062292d.run_wall_time_us) (tablet-download-pool-c80067ebc4504518a6429c342c100642.queue_time_us, tablet-download-pool-c80067ebc4504518a6429c342c100642.queue_time_us) (tablet-download-pool-c80067ebc4504518a6429c342c100642.run_cpu_time_us, tablet-download-pool-c80067ebc4504518a6429c342c100642.run_cpu_time_us) (tablet-download-pool-c80067ebc4504518a6429c342c100642.run_wall_time_us, tablet-download-pool-c80067ebc4504518a6429c342c100642.run_wall_time_us) (tablet-download-pool-daf758a9a8314106bcb1ed7abb8cc220.queue_time_us, tablet-download-pool-daf758a9a8314106bcb1ed7abb8cc220.queue_time_us) (tablet-download-pool-daf758a9a8314106bcb1ed7abb8cc220.run_cpu_time_us, tablet-download-pool-daf758a9a8314106bcb1ed7abb8cc220.run_cpu_time_us) (tablet-download-pool-daf758a9a8314106bcb1ed7abb8cc220.run_wall_time_us, tablet-download-pool-daf758a9a8314106bcb1ed7abb8cc220.run_wall_time_us) (tablet-download-pool-e989cc9924b04f018e332d78582556f1.queue_time_us, tablet-download-pool-e989cc9924b04f018e332d78582556f1.queue_time_us) (tablet-download-pool-e989cc9924b04f018e332d78582556f1.run_cpu_time_us, tablet-download-pool-e989cc9924b04f018e332d78582556f1.run_cpu_time_us) (tablet-download-pool-e989cc9924b04f018e332d78582556f1.run_wall_time_us, tablet-download-pool-e989cc9924b04f018e332d78582556f1.run_wall_time_us) (tablet-download-pool-f88bd39a1f614d9987a0f306980b19d7.queue_time_us, tablet-download-pool-f88bd39a1f614d9987a0f306980b19d7.queue_time_us) (tablet-download-pool-f956dfc843814ccd92546e00110c79ca.queue_time_us, tablet-download-pool-f956dfc843814ccd92546e00110c79ca.queue_time_us) (tablet-download-pool-f956dfc843814ccd92546e00110c79ca.run_cpu_time_us, tablet-download-pool-f956dfc843814ccd92546e00110c79ca.run_cpu_time_us) (tablet-download-pool-f956dfc843814ccd92546e00110c79ca.run_wall_time_us, tablet-download-pool-f956dfc843814ccd92546e00110c79ca.run_wall_time_us) (tablet-download-pool-fb046706fc504c47870d1f084489befe.queue_time_us, tablet-download-pool-fb046706fc504c47870d1f084489befe.queue_time_us) (tablet-download-pool-fb046706fc504c47870d1f084489befe.run_cpu_time_us, tablet-download-pool-fb046706fc504c47870d1f084489befe.run_cpu_time_us) (tablet-download-pool-fb046706fc504c47870d1f084489befe.run_wall_time_us, tablet-download-pool-fb046706fc504c47870d1f084489befe.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714659462 (unix time) try "date -d @1714659462" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800004ac0) received by PID 19136 (TID 0x7f7bf0daa700) from PID 19136; stack trace: ***
@ 0x7f7c9aaac980 (unknown) at ??:0
@ 0x7f7c8fdf9fb7 gsignal at ??:0
@ 0x7f7c8fdfb921 abort at ??:0
@ 0x7f7c928aedcd google::LogMessage::Fail() at ??:0
@ 0x7f7c928b2b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f7c928ae7cc google::LogMessage::Flush() at ??:0
I20240502 14:17:42.076905 21205 ts_tablet_manager.cc:902] T 36124283cbed413fb7b7e2ca9bf6e9ed P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
@ 0x7f7c928aff59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f7c93f2b742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7f7c93ef7f8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7f7c93ef1cd6 kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f7ca33bd8de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f7ca33d5daf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f7ca3500480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f7ca3538a8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f7ca351b981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7f7ca351b70e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f7ca83bd98d std::function<>::operator()() at ??:0
@ 0x7f7c93efbb75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7c93eff19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f7c93eff019 std::_Function_handler<>::_M_invoke() at ??:0
I20240502 14:17:42.161638 21217 ts_tablet_manager.cc:902] T 45c28c2c6be74c10a33f46e52affd378 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer 14e6d73ccbc9463cbc192df0e4d125ac (127.18.176.1:46599)
@ 0x7f7ca83bd98d std::function<>::operator()() at ??:0
I20240502 14:17:42.167611 21219 ts_tablet_manager.cc:902] T 17922984561e4a82922c5080dd75e8c3 P e0f292d80247413b9d1b6ef13fc61aea: Initiating tablet copy from peer cb48b1aadcdc4b5b9ebfd1375b7bcb63 (127.18.176.2:35997)
@ 0x7f7c93eda01e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7c9aaa16db start_thread at ??:0
@ 0x7f7c8fedc71f clone at ??:0