[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240503 08:00:31.454861 396 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.99.62:37461
I20240503 08:00:31.455861 396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:00:31.456473 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:00:31.464182 396 server_base.cc:1034] running on GCE node
W20240503 08:00:31.464630 401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.465099 402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.465153 404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:31.465760 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:31.465880 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:31.465917 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723231465916 us; error 0 us; skew 500 ppm
I20240503 08:00:31.467875 396 webserver.cc:460] Webserver started at http://127.0.99.62:34461/ using document root <none> and password file <none>
I20240503 08:00:31.468415 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:31.468469 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:31.468662 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:31.470254 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/master-0-root/instance:
uuid: "2bec411dfd9340979b5e687f7763f705"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.473701 396 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240503 08:00:31.475770 409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.476821 396 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:00:31.476938 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/master-0-root
uuid: "2bec411dfd9340979b5e687f7763f705"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.477025 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:31.501534 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:31.502104 396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:00:31.502272 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:31.508543 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.62:37461
I20240503 08:00:31.508544 461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.62:37461 every 8 connection(s)
I20240503 08:00:31.511591 462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.517331 462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705: Bootstrap starting.
I20240503 08:00:31.519626 462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.520388 462 log.cc:824] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705: Log is configured to *not* fsync() on all Append() calls
I20240503 08:00:31.521836 462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705: No bootstrap required, opened a new log
I20240503 08:00:31.524583 462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bec411dfd9340979b5e687f7763f705" member_type: VOTER }
I20240503 08:00:31.524729 462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.524784 462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bec411dfd9340979b5e687f7763f705, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.525257 462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bec411dfd9340979b5e687f7763f705" member_type: VOTER }
I20240503 08:00:31.525388 462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:00:31.525450 462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:00:31.525555 462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.526255 462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bec411dfd9340979b5e687f7763f705" member_type: VOTER }
I20240503 08:00:31.526593 462 leader_election.cc:302] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bec411dfd9340979b5e687f7763f705; no voters:
I20240503 08:00:31.526849 462 leader_election.cc:288] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:00:31.526979 465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.527204 465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 1 LEADER]: Becoming Leader. State: Replica: 2bec411dfd9340979b5e687f7763f705, State: Running, Role: LEADER
I20240503 08:00:31.527570 465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bec411dfd9340979b5e687f7763f705" member_type: VOTER }
I20240503 08:00:31.527951 462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:00:31.529153 467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bec411dfd9340979b5e687f7763f705. Latest consensus state: current_term: 1 leader_uuid: "2bec411dfd9340979b5e687f7763f705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bec411dfd9340979b5e687f7763f705" member_type: VOTER } }
I20240503 08:00:31.529170 466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bec411dfd9340979b5e687f7763f705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bec411dfd9340979b5e687f7763f705" member_type: VOTER } }
I20240503 08:00:31.529274 466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [sys.catalog]: This master's current role is: LEADER
I20240503 08:00:31.529273 467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [sys.catalog]: This master's current role is: LEADER
I20240503 08:00:31.529618 475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:00:31.529870 396 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 08:00:31.532406 475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:00:31.537709 475 catalog_manager.cc:1347] Generated new cluster ID: 4e1bedd104bc471f981239c58cb2b95a
I20240503 08:00:31.537781 475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:00:31.562126 475 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:00:31.563021 475 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:00:31.576279 475 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705: Generated new TSK 0
I20240503 08:00:31.576947 475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:00:31.594974 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:00:31.597776 484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.598472 485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.598999 487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:31.599517 396 server_base.cc:1034] running on GCE node
I20240503 08:00:31.599689 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:31.599725 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:31.599746 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723231599745 us; error 0 us; skew 500 ppm
I20240503 08:00:31.600692 396 webserver.cc:460] Webserver started at http://127.0.99.1:45139/ using document root <none> and password file <none>
I20240503 08:00:31.600839 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:31.600890 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:31.600968 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:31.601331 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-0-root/instance:
uuid: "57fdf9221a974ac0ab6ec530086fce91"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.602682 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240503 08:00:31.603579 492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.603794 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.603857 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-0-root
uuid: "57fdf9221a974ac0ab6ec530086fce91"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.603920 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:31.611557 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:31.611932 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:31.612583 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:00:31.613341 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:00:31.613394 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.613435 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:00:31.613461 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.618902 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.1:44061
I20240503 08:00:31.618957 555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.1:44061 every 8 connection(s)
I20240503 08:00:31.619843 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:00:31.622581 563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.623204 561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:31.623747 396 server_base.cc:1034] running on GCE node
W20240503 08:00:31.624264 560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:31.624509 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:31.624557 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:31.624576 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723231624576 us; error 0 us; skew 500 ppm
I20240503 08:00:31.625634 396 webserver.cc:460] Webserver started at http://127.0.99.2:45379/ using document root <none> and password file <none>
I20240503 08:00:31.625793 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:31.625838 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:31.625900 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:31.626336 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-1-root/instance:
uuid: "85f49d291abb4177b0d513974a35fa9e"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.628055 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20240503 08:00:31.629294 556 heartbeater.cc:347] Connected to a master server at 127.0.99.62:37461
I20240503 08:00:31.629479 556 heartbeater.cc:464] Registering TS with master...
I20240503 08:00:31.629864 556 heartbeater.cc:511] Master 127.0.99.62:37461 requested a full tablet report, sending...
I20240503 08:00:31.631173 426 ts_manager.cc:194] Registered new tserver with Master: 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061)
I20240503 08:00:31.631573 568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.631829 396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20240503 08:00:31.631939 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-1-root
uuid: "85f49d291abb4177b0d513974a35fa9e"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.632048 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:31.632586 426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37902
I20240503 08:00:31.640995 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:31.641391 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:31.641672 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:00:31.642119 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:00:31.642158 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.642202 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:00:31.642230 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.646395 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.2:36631
I20240503 08:00:31.646456 631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.2:36631 every 8 connection(s)
I20240503 08:00:31.647166 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:00:31.649784 396 server_base.cc:1034] running on GCE node
W20240503 08:00:31.650416 635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.650990 636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:31.651566 638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:31.651804 632 heartbeater.cc:347] Connected to a master server at 127.0.99.62:37461
I20240503 08:00:31.651815 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:31.651886 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:31.651906 632 heartbeater.cc:464] Registering TS with master...
I20240503 08:00:31.651912 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723231651911 us; error 0 us; skew 500 ppm
I20240503 08:00:31.652132 632 heartbeater.cc:511] Master 127.0.99.62:37461 requested a full tablet report, sending...
I20240503 08:00:31.652753 426 ts_manager.cc:194] Registered new tserver with Master: 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:31.652974 396 webserver.cc:460] Webserver started at http://127.0.99.3:34673/ using document root <none> and password file <none>
I20240503 08:00:31.653136 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:31.653187 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:31.653264 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:31.653395 426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37912
I20240503 08:00:31.653656 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-2-root/instance:
uuid: "d65518aba2604740a74c710b546f1daa"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.655164 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240503 08:00:31.656085 643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.656354 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.656423 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-2-root
uuid: "d65518aba2604740a74c710b546f1daa"
format_stamp: "Formatted at 2024-05-03 08:00:31 on dist-test-slave-gf01"
I20240503 08:00:31.656491 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723231444759-396-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:31.673441 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:31.673846 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:31.674139 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:00:31.674572 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:00:31.674611 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.674656 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:00:31.674683 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:31.679738 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.3:33723
I20240503 08:00:31.679790 706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.3:33723 every 8 connection(s)
I20240503 08:00:31.684186 707 heartbeater.cc:347] Connected to a master server at 127.0.99.62:37461
I20240503 08:00:31.684291 707 heartbeater.cc:464] Registering TS with master...
I20240503 08:00:31.684506 707 heartbeater.cc:511] Master 127.0.99.62:37461 requested a full tablet report, sending...
I20240503 08:00:31.685108 426 ts_manager.cc:194] Registered new tserver with Master: d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.685592 426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37914
I20240503 08:00:31.685833 396 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005689577s
I20240503 08:00:31.686342 396 test_util.cc:268] Using random seed: 488431298
I20240503 08:00:31.696897 426 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 08:00:31.698429 426 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 08:00:31.712769 520 tablet_service.cc:1467] Processing CreateTablet for tablet c719d1676a3f472e95ebc9f89270b2c8 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 08:00:31.712859 515 tablet_service.cc:1467] Processing CreateTablet for tablet fa584eb4aafd4861b946c541bfc59edd (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 08:00:31.712922 516 tablet_service.cc:1467] Processing CreateTablet for tablet 0a74432272ce4679a526957941139df0 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 08:00:31.713232 519 tablet_service.cc:1467] Processing CreateTablet for tablet d787805bbd574e288a8d553c20837dd4 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 08:00:31.713300 512 tablet_service.cc:1467] Processing CreateTablet for tablet f1f903fa33564e05aacaa03f3e85876f (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 08:00:31.713472 517 tablet_service.cc:1467] Processing CreateTablet for tablet e19772cba389428380be034490247369 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 08:00:31.713619 514 tablet_service.cc:1467] Processing CreateTablet for tablet f7f163804b59413c9b6aea12230aea1e (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 08:00:31.713685 513 tablet_service.cc:1467] Processing CreateTablet for tablet 726d5dadaf9340668a0412e2154d24da (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 08:00:31.713812 596 tablet_service.cc:1467] Processing CreateTablet for tablet f321fdb898064435a536dbc460609fd5 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 08:00:31.713940 588 tablet_service.cc:1467] Processing CreateTablet for tablet f1f903fa33564e05aacaa03f3e85876f (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 08:00:31.714155 596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f321fdb898064435a536dbc460609fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.714252 670 tablet_service.cc:1467] Processing CreateTablet for tablet c719d1676a3f472e95ebc9f89270b2c8 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 08:00:31.714303 589 tablet_service.cc:1467] Processing CreateTablet for tablet 726d5dadaf9340668a0412e2154d24da (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 08:00:31.714495 670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c719d1676a3f472e95ebc9f89270b2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.714524 589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726d5dadaf9340668a0412e2154d24da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.714618 671 tablet_service.cc:1467] Processing CreateTablet for tablet f321fdb898064435a536dbc460609fd5 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 08:00:31.714821 671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f321fdb898064435a536dbc460609fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.716161 668 tablet_service.cc:1467] Processing CreateTablet for tablet 0a74432272ce4679a526957941139df0 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 08:00:31.716229 590 tablet_service.cc:1467] Processing CreateTablet for tablet fa584eb4aafd4861b946c541bfc59edd (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 08:00:31.716387 668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a74432272ce4679a526957941139df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.716442 590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa584eb4aafd4861b946c541bfc59edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.717471 722 tablet_bootstrap.cc:492] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.717535 667 tablet_service.cc:1467] Processing CreateTablet for tablet e19772cba389428380be034490247369 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 08:00:31.717748 667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e19772cba389428380be034490247369. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.718370 722 tablet_bootstrap.cc:654] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.718334 591 tablet_service.cc:1467] Processing CreateTablet for tablet f7f163804b59413c9b6aea12230aea1e (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 08:00:31.718547 591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7f163804b59413c9b6aea12230aea1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.718755 666 tablet_service.cc:1467] Processing CreateTablet for tablet f7f163804b59413c9b6aea12230aea1e (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 08:00:31.718968 666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7f163804b59413c9b6aea12230aea1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.719470 722 tablet_bootstrap.cc:492] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.719604 722 ts_tablet_manager.cc:1367] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:31.719707 595 tablet_service.cc:1467] Processing CreateTablet for tablet c719d1676a3f472e95ebc9f89270b2c8 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 08:00:31.719944 595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c719d1676a3f472e95ebc9f89270b2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.720079 665 tablet_service.cc:1467] Processing CreateTablet for tablet fa584eb4aafd4861b946c541bfc59edd (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 08:00:31.720300 665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa584eb4aafd4861b946c541bfc59edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.720252 722 raft_consensus.cc:348] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.720479 722 raft_consensus.cc:374] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.720558 722 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.720759 722 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.721179 722 ts_tablet_manager.cc:1398] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.721146 592 tablet_service.cc:1467] Processing CreateTablet for tablet e19772cba389428380be034490247369 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 08:00:31.721418 592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e19772cba389428380be034490247369. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.721447 664 tablet_service.cc:1467] Processing CreateTablet for tablet 726d5dadaf9340668a0412e2154d24da (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 08:00:31.721658 664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726d5dadaf9340668a0412e2154d24da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.721690 594 tablet_service.cc:1467] Processing CreateTablet for tablet d787805bbd574e288a8d553c20837dd4 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 08:00:31.721911 594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d787805bbd574e288a8d553c20837dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.722766 663 tablet_service.cc:1467] Processing CreateTablet for tablet f1f903fa33564e05aacaa03f3e85876f (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 08:00:31.722932 663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f903fa33564e05aacaa03f3e85876f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.721418 593 tablet_service.cc:1467] Processing CreateTablet for tablet 0a74432272ce4679a526957941139df0 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 08:00:31.723373 593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a74432272ce4679a526957941139df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.723660 588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f903fa33564e05aacaa03f3e85876f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.723928 669 tablet_service.cc:1467] Processing CreateTablet for tablet d787805bbd574e288a8d553c20837dd4 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 08:00:31.724107 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d787805bbd574e288a8d553c20837dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.725201 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa584eb4aafd4861b946c541bfc59edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.725456 722 tablet_bootstrap.cc:492] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.725481 632 heartbeater.cc:503] Master 127.0.99.62:37461 was elected leader, sending a full tablet report...
I20240503 08:00:31.726166 722 tablet_bootstrap.cc:654] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.712769 518 tablet_service.cc:1467] Processing CreateTablet for tablet f321fdb898064435a536dbc460609fd5 (DEFAULT_TABLE table=test-workload [id=af07af5a2a58450fbc0ac37a75aef160]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 08:00:31.726887 518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f321fdb898064435a536dbc460609fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.727320 725 tablet_bootstrap.cc:492] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.727382 722 tablet_bootstrap.cc:492] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.727485 722 ts_tablet_manager.cc:1367] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:31.727919 722 raft_consensus.cc:348] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.728024 722 raft_consensus.cc:374] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.728053 722 raft_consensus.cc:729] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.728160 722 consensus_queue.cc:260] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.728340 725 tablet_bootstrap.cc:654] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.728487 722 ts_tablet_manager.cc:1398] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.728642 722 tablet_bootstrap.cc:492] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.728780 520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c719d1676a3f472e95ebc9f89270b2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.728902 519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d787805bbd574e288a8d553c20837dd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.729502 722 tablet_bootstrap.cc:654] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.730722 722 tablet_bootstrap.cc:492] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.730811 722 ts_tablet_manager.cc:1367] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:31.731200 722 raft_consensus.cc:348] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.731289 722 raft_consensus.cc:374] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.731319 722 raft_consensus.cc:729] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.731426 722 consensus_queue.cc:260] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.731791 722 ts_tablet_manager.cc:1398] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.731940 722 tablet_bootstrap.cc:492] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.732568 728 tablet_bootstrap.cc:492] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.732791 722 tablet_bootstrap.cc:654] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.733567 728 tablet_bootstrap.cc:654] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.733743 512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1f903fa33564e05aacaa03f3e85876f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.734354 517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e19772cba389428380be034490247369. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.734494 516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a74432272ce4679a526957941139df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.735968 728 tablet_bootstrap.cc:492] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.736063 728 ts_tablet_manager.cc:1367] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:00:31.736129 725 tablet_bootstrap.cc:492] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.736203 725 ts_tablet_manager.cc:1367] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:00:31.736371 513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726d5dadaf9340668a0412e2154d24da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.736454 728 raft_consensus.cc:348] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.736802 728 raft_consensus.cc:374] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.736847 728 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.736963 728 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.736605 725 raft_consensus.cc:348] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.737247 725 raft_consensus.cc:374] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.737291 725 raft_consensus.cc:729] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.737304 728 ts_tablet_manager.cc:1398] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.737381 725 consensus_queue.cc:260] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.737469 728 tablet_bootstrap.cc:492] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.737709 725 ts_tablet_manager.cc:1398] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.737886 725 tablet_bootstrap.cc:492] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.738240 707 heartbeater.cc:503] Master 127.0.99.62:37461 was elected leader, sending a full tablet report...
I20240503 08:00:31.738330 728 tablet_bootstrap.cc:654] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.738656 725 tablet_bootstrap.cc:654] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.738698 556 heartbeater.cc:503] Master 127.0.99.62:37461 was elected leader, sending a full tablet report...
I20240503 08:00:31.739167 514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7f163804b59413c9b6aea12230aea1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:31.741207 728 tablet_bootstrap.cc:492] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.741286 728 ts_tablet_manager.cc:1367] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:00:31.741559 722 tablet_bootstrap.cc:492] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.741637 722 ts_tablet_manager.cc:1367] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240503 08:00:31.741827 728 raft_consensus.cc:348] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.741927 728 raft_consensus.cc:374] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.741966 728 raft_consensus.cc:729] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.742030 722 raft_consensus.cc:348] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.742113 722 raft_consensus.cc:374] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.742084 728 consensus_queue.cc:260] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.742162 722 raft_consensus.cc:729] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.742261 722 consensus_queue.cc:260] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.742336 728 ts_tablet_manager.cc:1398] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.742486 722 ts_tablet_manager.cc:1398] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.742620 722 tablet_bootstrap.cc:492] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.742738 728 tablet_bootstrap.cc:492] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.743513 722 tablet_bootstrap.cc:654] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.744323 728 tablet_bootstrap.cc:654] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.744554 722 tablet_bootstrap.cc:492] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.744643 722 ts_tablet_manager.cc:1367] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:00:31.745071 722 raft_consensus.cc:348] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.745173 722 raft_consensus.cc:374] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.745209 722 raft_consensus.cc:729] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.745309 722 consensus_queue.cc:260] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.745573 722 ts_tablet_manager.cc:1398] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.745739 722 tablet_bootstrap.cc:492] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.746555 728 tablet_bootstrap.cc:492] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.746595 722 tablet_bootstrap.cc:654] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.746632 728 ts_tablet_manager.cc:1367] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:00:31.746814 725 tablet_bootstrap.cc:492] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.746894 725 ts_tablet_manager.cc:1367] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:00:31.747033 728 raft_consensus.cc:348] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.747117 728 raft_consensus.cc:374] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.747148 728 raft_consensus.cc:729] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.747257 728 consensus_queue.cc:260] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.747540 728 ts_tablet_manager.cc:1398] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.747596 722 tablet_bootstrap.cc:492] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.747668 722 ts_tablet_manager.cc:1367] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:00:31.747706 728 tablet_bootstrap.cc:492] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.748051 722 raft_consensus.cc:348] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.748163 722 raft_consensus.cc:374] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.748208 722 raft_consensus.cc:729] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.748323 722 consensus_queue.cc:260] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.748569 728 tablet_bootstrap.cc:654] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.748663 722 ts_tablet_manager.cc:1398] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.748813 722 tablet_bootstrap.cc:492] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.747257 725 raft_consensus.cc:348] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.749553 725 raft_consensus.cc:374] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.749598 725 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.749640 722 tablet_bootstrap.cc:654] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.749704 725 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.749922 725 ts_tablet_manager.cc:1398] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:00:31.750658 722 tablet_bootstrap.cc:492] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.750730 725 tablet_bootstrap.cc:492] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.750735 722 ts_tablet_manager.cc:1367] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:31.751139 722 raft_consensus.cc:348] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.751243 722 raft_consensus.cc:374] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.751283 722 raft_consensus.cc:729] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.751367 722 consensus_queue.cc:260] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.751627 725 tablet_bootstrap.cc:654] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.751734 722 ts_tablet_manager.cc:1398] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.751881 722 tablet_bootstrap.cc:492] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.752616 722 tablet_bootstrap.cc:654] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.752858 725 tablet_bootstrap.cc:492] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.752943 725 ts_tablet_manager.cc:1367] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:31.753355 725 raft_consensus.cc:348] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.753454 725 raft_consensus.cc:374] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.753465 728 tablet_bootstrap.cc:492] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.753535 725 raft_consensus.cc:729] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.753590 728 ts_tablet_manager.cc:1367] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:00:31.753700 725 consensus_queue.cc:260] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.754015 725 ts_tablet_manager.cc:1398] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.753974 728 raft_consensus.cc:348] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.754069 728 raft_consensus.cc:374] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.754098 728 raft_consensus.cc:729] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.754199 725 tablet_bootstrap.cc:492] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.754199 728 consensus_queue.cc:260] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.754454 728 ts_tablet_manager.cc:1398] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.754593 722 tablet_bootstrap.cc:492] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.754626 728 tablet_bootstrap.cc:492] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.754660 722 ts_tablet_manager.cc:1367] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:00:31.755203 722 raft_consensus.cc:348] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.755290 722 raft_consensus.cc:374] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.755326 722 raft_consensus.cc:729] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.755517 728 tablet_bootstrap.cc:654] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.755470 722 consensus_queue.cc:260] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.755756 722 ts_tablet_manager.cc:1398] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.756325 722 tablet_bootstrap.cc:492] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: Bootstrap starting.
I20240503 08:00:31.756520 728 tablet_bootstrap.cc:492] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.756598 728 ts_tablet_manager.cc:1367] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:00:31.756995 728 raft_consensus.cc:348] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.757105 728 raft_consensus.cc:374] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.757149 728 raft_consensus.cc:729] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.757153 722 tablet_bootstrap.cc:654] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.757267 728 consensus_queue.cc:260] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.757534 728 ts_tablet_manager.cc:1398] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:31.757679 728 tablet_bootstrap.cc:492] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.758500 728 tablet_bootstrap.cc:654] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.759426 725 tablet_bootstrap.cc:654] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.759757 728 tablet_bootstrap.cc:492] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.759846 728 ts_tablet_manager.cc:1367] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:00:31.759923 722 tablet_bootstrap.cc:492] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: No bootstrap required, opened a new log
I20240503 08:00:31.760003 722 ts_tablet_manager.cc:1367] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:00:31.760244 728 raft_consensus.cc:348] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.760334 728 raft_consensus.cc:374] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.760365 728 raft_consensus.cc:729] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.760334 722 raft_consensus.cc:348] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.760483 722 raft_consensus.cc:374] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.760519 722 raft_consensus.cc:729] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.760589 728 consensus_queue.cc:260] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.760617 722 consensus_queue.cc:260] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.760843 728 ts_tablet_manager.cc:1398] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:31.760854 722 ts_tablet_manager.cc:1398] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.761065 728 tablet_bootstrap.cc:492] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.761752 728 tablet_bootstrap.cc:654] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.762137 725 tablet_bootstrap.cc:492] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.762266 725 ts_tablet_manager.cc:1367] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240503 08:00:31.762706 725 raft_consensus.cc:348] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.762867 725 raft_consensus.cc:374] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.762923 725 raft_consensus.cc:729] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.763029 725 consensus_queue.cc:260] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.763188 728 tablet_bootstrap.cc:492] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.763263 728 ts_tablet_manager.cc:1367] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:00:31.763374 725 ts_tablet_manager.cc:1398] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.763538 725 tablet_bootstrap.cc:492] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.763662 728 raft_consensus.cc:348] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.763753 728 raft_consensus.cc:374] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.763790 728 raft_consensus.cc:729] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.763903 728 consensus_queue.cc:260] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.764163 728 ts_tablet_manager.cc:1398] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.764305 728 tablet_bootstrap.cc:492] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.764705 725 tablet_bootstrap.cc:654] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.765125 728 tablet_bootstrap.cc:654] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.766278 725 tablet_bootstrap.cc:492] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.766359 725 ts_tablet_manager.cc:1367] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:00:31.766656 725 raft_consensus.cc:348] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.766731 725 raft_consensus.cc:374] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.766757 725 raft_consensus.cc:729] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.766860 725 consensus_queue.cc:260] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.767078 725 ts_tablet_manager.cc:1398] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.767246 725 tablet_bootstrap.cc:492] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.767799 728 tablet_bootstrap.cc:492] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.767874 728 ts_tablet_manager.cc:1367] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:00:31.768182 725 tablet_bootstrap.cc:654] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.768257 728 raft_consensus.cc:348] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.768343 728 raft_consensus.cc:374] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.768373 728 raft_consensus.cc:729] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.768474 728 consensus_queue.cc:260] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.768743 728 ts_tablet_manager.cc:1398] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.768898 728 tablet_bootstrap.cc:492] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa: Bootstrap starting.
I20240503 08:00:31.769716 728 tablet_bootstrap.cc:654] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.770044 725 tablet_bootstrap.cc:492] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.770117 725 ts_tablet_manager.cc:1367] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:00:31.770449 725 raft_consensus.cc:348] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.770555 725 raft_consensus.cc:374] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.770594 725 raft_consensus.cc:729] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.770714 728 tablet_bootstrap.cc:492] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa: No bootstrap required, opened a new log
I20240503 08:00:31.770701 725 consensus_queue.cc:260] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.770789 728 ts_tablet_manager.cc:1367] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:31.770963 725 ts_tablet_manager.cc:1398] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.771103 725 tablet_bootstrap.cc:492] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.771241 728 raft_consensus.cc:348] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.771332 728 raft_consensus.cc:374] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.771365 728 raft_consensus.cc:729] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.771492 728 consensus_queue.cc:260] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.771808 728 ts_tablet_manager.cc:1398] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.771847 725 tablet_bootstrap.cc:654] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.773093 725 tablet_bootstrap.cc:492] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.773176 725 ts_tablet_manager.cc:1367] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:31.773545 725 raft_consensus.cc:348] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.773651 725 raft_consensus.cc:374] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.773690 725 raft_consensus.cc:729] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.773808 725 consensus_queue.cc:260] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.774076 725 ts_tablet_manager.cc:1398] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.774230 725 tablet_bootstrap.cc:492] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.775079 725 tablet_bootstrap.cc:654] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.776063 725 tablet_bootstrap.cc:492] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.776142 725 ts_tablet_manager.cc:1367] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:31.776468 725 raft_consensus.cc:348] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.776546 725 raft_consensus.cc:374] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.776573 725 raft_consensus.cc:729] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.776695 725 consensus_queue.cc:260] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.776919 725 ts_tablet_manager.cc:1398] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:31.777132 725 tablet_bootstrap.cc:492] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: Bootstrap starting.
I20240503 08:00:31.777809 725 tablet_bootstrap.cc:654] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:31.778641 725 tablet_bootstrap.cc:492] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: No bootstrap required, opened a new log
I20240503 08:00:31.778714 725 ts_tablet_manager.cc:1367] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:31.779063 725 raft_consensus.cc:348] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.779153 725 raft_consensus.cc:374] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:31.779183 725 raft_consensus.cc:729] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Initialized, Role: FOLLOWER
I20240503 08:00:31.779286 725 consensus_queue.cc:260] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.779543 725 ts_tablet_manager.cc:1398] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:31.783288 734 raft_consensus.cc:482] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.783363 734 raft_consensus.cc:504] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.784186 734 leader_election.cc:288] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:31.787235 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91" is_pre_election: true
I20240503 08:00:31.787489 530 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 0.
I20240503 08:00:31.787678 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e" is_pre_election: true
I20240503 08:00:31.787784 606 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 0.
I20240503 08:00:31.787827 647 leader_election.cc:302] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.787967 734 raft_consensus.cc:2781] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.788040 734 raft_consensus.cc:482] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.788069 734 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.788802 734 raft_consensus.cc:504] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.789078 734 leader_election.cc:288] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:31.789321 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:31.789330 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:31.789438 530 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.789466 606 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.790292 530 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 1.
I20240503 08:00:31.790292 606 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 1.
I20240503 08:00:31.790561 647 leader_election.cc:302] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.790694 734 raft_consensus.cc:2781] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.790856 734 raft_consensus.cc:686] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:31.790983 734 consensus_queue.cc:237] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.792585 730 raft_consensus.cc:482] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.792667 730 raft_consensus.cc:504] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.793082 730 leader_election.cc:288] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.793000 424 catalog_manager.cc:5484] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 0 to 1, leader changed from <none> to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 1 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:31.796023 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91" is_pre_election: true
I20240503 08:00:31.796123 530 raft_consensus.cc:2454] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.796327 572 leader_election.cc:302] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.796468 730 raft_consensus.cc:2781] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.796522 730 raft_consensus.cc:482] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.796566 730 raft_consensus.cc:3037] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.796749 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.796847 681 raft_consensus.cc:2454] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.797370 730 raft_consensus.cc:504] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.797619 730 leader_election.cc:288] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.797914 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:31.797899 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.798033 530 raft_consensus.cc:3037] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.798035 681 raft_consensus.cc:3037] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.798784 530 raft_consensus.cc:2454] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.798784 681 raft_consensus.cc:2454] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.799033 572 leader_election.cc:302] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.799216 730 raft_consensus.cc:2781] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.799283 730 raft_consensus.cc:686] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:31.799400 730 consensus_queue.cc:237] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.800668 424 catalog_manager.cc:5484] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 1 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:31.841030 735 raft_consensus.cc:482] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.841171 735 raft_consensus.cc:504] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.841688 735 leader_election.cc:288] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.844810 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.844836 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e" is_pre_election: true
I20240503 08:00:31.844933 681 raft_consensus.cc:2454] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 0.
I20240503 08:00:31.844959 606 raft_consensus.cc:2454] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 0.
I20240503 08:00:31.845191 494 leader_election.cc:302] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.845351 735 raft_consensus.cc:2781] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.845392 735 raft_consensus.cc:482] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.845428 735 raft_consensus.cc:3037] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.846227 735 raft_consensus.cc:504] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.846525 735 leader_election.cc:288] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.846772 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:31.846772 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.846902 681 raft_consensus.cc:3037] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.846900 606 raft_consensus.cc:3037] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.847782 681 raft_consensus.cc:2454] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 1.
I20240503 08:00:31.847787 606 raft_consensus.cc:2454] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 1.
I20240503 08:00:31.848060 496 leader_election.cc:302] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.848228 735 raft_consensus.cc:2781] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.848425 735 raft_consensus.cc:686] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:31.848574 735 consensus_queue.cc:237] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.850015 424 catalog_manager.cc:5484] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:31.861200 735 raft_consensus.cc:482] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.861303 735 raft_consensus.cc:504] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.861625 735 leader_election.cc:288] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.861966 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e" is_pre_election: true
I20240503 08:00:31.861982 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.862120 606 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 0.
I20240503 08:00:31.862160 681 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 0.
I20240503 08:00:31.862349 496 leader_election.cc:302] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.862496 735 raft_consensus.cc:2781] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.862550 735 raft_consensus.cc:482] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.862596 735 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.863377 735 raft_consensus.cc:504] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.863744 735 leader_election.cc:288] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.863976 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:31.864022 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.864115 606 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.864116 681 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.864961 681 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 1.
I20240503 08:00:31.864961 606 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 1.
I20240503 08:00:31.865248 496 leader_election.cc:302] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.865384 735 raft_consensus.cc:2781] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.865453 735 raft_consensus.cc:686] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:31.865585 735 consensus_queue.cc:237] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.867007 424 catalog_manager.cc:5484] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
W20240503 08:00:31.869635 557 tablet.cc:2369] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240503 08:00:31.902758 730 raft_consensus.cc:482] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.902892 730 raft_consensus.cc:504] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.903251 730 leader_election.cc:288] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.903640 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91" is_pre_election: true
I20240503 08:00:31.903642 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.903786 530 raft_consensus.cc:2454] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.903788 681 raft_consensus.cc:2454] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.904034 572 leader_election.cc:302] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.904188 730 raft_consensus.cc:2781] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.904242 730 raft_consensus.cc:482] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.904278 730 raft_consensus.cc:3037] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.905064 730 raft_consensus.cc:504] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.905386 730 leader_election.cc:288] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.905633 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:31.905633 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.905754 530 raft_consensus.cc:3037] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.905754 681 raft_consensus.cc:3037] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.906594 530 raft_consensus.cc:2454] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.906594 681 raft_consensus.cc:2454] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.906858 570 leader_election.cc:302] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.906992 730 raft_consensus.cc:2781] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.907073 730 raft_consensus.cc:686] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:31.907198 730 consensus_queue.cc:237] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.908703 424 catalog_manager.cc:5484] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 1 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:31.916849 734 raft_consensus.cc:482] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.916936 734 raft_consensus.cc:504] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.917245 734 leader_election.cc:288] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:31.917524 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91" is_pre_election: true
I20240503 08:00:31.917582 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e" is_pre_election: true
I20240503 08:00:31.917630 530 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 0.
I20240503 08:00:31.917682 606 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 0.
I20240503 08:00:31.917837 647 leader_election.cc:302] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.917987 734 raft_consensus.cc:2781] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.918037 734 raft_consensus.cc:482] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.918064 734 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.918814 734 raft_consensus.cc:504] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.919097 734 leader_election.cc:288] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:31.919358 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:31.919510 530 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.920185 530 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 1.
I20240503 08:00:31.920425 647 leader_election.cc:302] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.920431 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:31.920554 606 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.920614 734 raft_consensus.cc:2781] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.920692 734 raft_consensus.cc:686] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:31.920838 734 consensus_queue.cc:237] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.921360 606 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 1.
I20240503 08:00:31.922448 424 catalog_manager.cc:5484] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 0 to 1, leader changed from <none> to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 1 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:31.927834 727 raft_consensus.cc:482] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.927930 727 raft_consensus.cc:504] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.928257 727 leader_election.cc:288] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.928550 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91" is_pre_election: true
I20240503 08:00:31.928659 530 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.928622 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.928778 681 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.928913 572 leader_election.cc:302] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.929108 727 raft_consensus.cc:2781] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.929169 727 raft_consensus.cc:482] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.929206 727 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.929948 727 raft_consensus.cc:504] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.930222 727 leader_election.cc:288] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.930550 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:31.930648 530 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.930871 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.930977 681 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.931528 530 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.931746 681 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.931802 572 leader_election.cc:302] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.931947 727 raft_consensus.cc:2781] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.932073 727 raft_consensus.cc:686] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:31.932205 727 consensus_queue.cc:237] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:31.933621 424 catalog_manager.cc:5484] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 1 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:31.957787 727 raft_consensus.cc:482] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.957921 727 raft_consensus.cc:504] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.958328 727 leader_election.cc:288] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.958714 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19772cba389428380be034490247369" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91" is_pre_election: true
I20240503 08:00:31.958714 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19772cba389428380be034490247369" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.958887 530 raft_consensus.cc:2454] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.958887 681 raft_consensus.cc:2454] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 0.
I20240503 08:00:31.959152 572 leader_election.cc:302] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.959304 727 raft_consensus.cc:2781] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.959362 727 raft_consensus.cc:482] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.959403 727 raft_consensus.cc:3037] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.960183 727 raft_consensus.cc:504] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.960489 727 leader_election.cc:288] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.960752 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19772cba389428380be034490247369" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:31.960796 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19772cba389428380be034490247369" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.960846 530 raft_consensus.cc:3037] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.960906 681 raft_consensus.cc:3037] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.961536 530 raft_consensus.cc:2454] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.961771 681 raft_consensus.cc:2454] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 1.
I20240503 08:00:31.962039 572 leader_election.cc:302] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.962177 727 raft_consensus.cc:2781] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.962257 727 raft_consensus.cc:686] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:31.962388 727 consensus_queue.cc:237] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.963958 424 catalog_manager.cc:5484] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 1 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:31.978683 735 raft_consensus.cc:482] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:31.978828 735 raft_consensus.cc:504] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.979209 735 leader_election.cc:288] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.979574 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa" is_pre_election: true
I20240503 08:00:31.979574 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e" is_pre_election: true
I20240503 08:00:31.979734 681 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 0.
I20240503 08:00:31.979746 606 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 0.
I20240503 08:00:31.980000 496 leader_election.cc:302] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:31.980168 735 raft_consensus.cc:2781] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:31.980237 735 raft_consensus.cc:482] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:31.980285 735 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.981173 735 raft_consensus.cc:504] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.981523 735 leader_election.cc:288] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:31.981781 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:31.981791 606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:31.981884 681 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.981911 606 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:31.982550 681 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 1.
I20240503 08:00:31.982583 606 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 1.
I20240503 08:00:31.982815 494 leader_election.cc:302] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:31.983026 735 raft_consensus.cc:2781] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:31.983108 735 raft_consensus.cc:686] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:31.983258 735 consensus_queue.cc:237] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:31.984772 424 catalog_manager.cc:5484] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:32.000404 606 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:35172
I20240503 08:00:32.000577 606 raft_consensus.cc:595] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Received request to transfer leadership to TS 57fdf9221a974ac0ab6ec530086fce91
I20240503 08:00:32.005807 681 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
mode: GRACEFUL
new_leader_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:43044
I20240503 08:00:32.005960 681 raft_consensus.cc:595] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Received request to transfer leadership to TS 57fdf9221a974ac0ab6ec530086fce91
I20240503 08:00:32.007572 681 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0a74432272ce4679a526957941139df0"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
mode: GRACEFUL
new_leader_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:43044
I20240503 08:00:32.007710 681 raft_consensus.cc:595] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Received request to transfer leadership to TS 57fdf9221a974ac0ab6ec530086fce91
I20240503 08:00:32.012305 530 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:50516
I20240503 08:00:32.012418 530 raft_consensus.cc:595] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:32.014246 530 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:50516
I20240503 08:00:32.014346 530 raft_consensus.cc:595] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:32.015663 606 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:35172
I20240503 08:00:32.015776 606 raft_consensus.cc:595] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Received request to transfer leadership to TS d65518aba2604740a74c710b546f1daa
I20240503 08:00:32.205168 758 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.207206 734 raft_consensus.cc:979] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: : Instructing follower 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:32.207324 758 raft_consensus.cc:1067] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Signalling peer 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:32.208278 530 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:50486
I20240503 08:00:32.208396 530 raft_consensus.cc:482] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:32.208447 530 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.208783 773 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.209434 530 raft_consensus.cc:504] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.210036 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:32.210168 681 raft_consensus.cc:3032] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:32.210216 681 raft_consensus.cc:729] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:32.210361 681 consensus_queue.cc:260] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.210649 681 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.211336 681 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:32.210036 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:32.211526 605 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.212337 605 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:32.212569 496 leader_election.cc:302] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:32.212649 530 leader_election.cc:288] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:32.212724 735 raft_consensus.cc:2781] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:32.212808 735 raft_consensus.cc:686] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:32.212946 735 consensus_queue.cc:237] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.214051 426 catalog_manager.cc:5484] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 1 to 2, leader changed from d65518aba2604740a74c710b546f1daa (127.0.99.3) to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:32.265401 735 consensus_queue.cc:1035] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.267148 763 raft_consensus.cc:979] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:32.267391 763 raft_consensus.cc:1067] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:32.267940 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35166
I20240503 08:00:32.268065 605 raft_consensus.cc:482] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:32.268126 605 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.269106 605 raft_consensus.cc:504] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.269564 735 consensus_queue.cc:1035] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.269687 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:32.269814 681 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.270077 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:32.270170 530 raft_consensus.cc:3032] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:32.270212 530 raft_consensus.cc:729] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:32.270326 530 consensus_queue.cc:260] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.270428 530 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.270697 681 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 2.
I20240503 08:00:32.270833 605 leader_election.cc:288] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 2 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:32.270882 727 consensus_queue.cc:1035] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.270946 570 leader_election.cc:302] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:32.271143 730 raft_consensus.cc:2781] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:32.271214 730 raft_consensus.cc:686] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:32.271296 530 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 2.
I20240503 08:00:32.271358 730 consensus_queue.cc:237] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.271942 681 raft_consensus.cc:1226] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Rejecting Update request from peer 57fdf9221a974ac0ab6ec530086fce91 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20240503 08:00:32.272615 426 catalog_manager.cc:5484] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 1 to 2, leader changed from 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 2 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:32.274593 727 consensus_queue.cc:1035] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.315457 727 consensus_queue.cc:1035] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.318125 783 consensus_queue.cc:1035] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.319675 730 raft_consensus.cc:979] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:32.319769 730 raft_consensus.cc:1067] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Signalling peer d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:32.320098 681 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:43024
I20240503 08:00:32.320202 681 raft_consensus.cc:482] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:32.320261 681 raft_consensus.cc:3037] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.320950 681 raft_consensus.cc:504] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.321255 681 leader_election.cc:288] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 2 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:32.321542 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:32.321645 530 raft_consensus.cc:3037] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.321702 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1f903fa33564e05aacaa03f3e85876f" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:32.321811 605 raft_consensus.cc:3032] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:32.321856 605 raft_consensus.cc:729] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:32.321982 605 consensus_queue.cc:260] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.322110 605 raft_consensus.cc:3037] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.322422 530 raft_consensus.cc:2454] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 2.
I20240503 08:00:32.322664 647 leader_election.cc:302] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:32.322815 758 raft_consensus.cc:2781] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:32.322824 605 raft_consensus.cc:2454] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 2.
I20240503 08:00:32.322899 758 raft_consensus.cc:686] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 2 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:32.323025 758 consensus_queue.cc:237] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.324292 424 catalog_manager.cc:5484] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 1 to 2, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 2 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:32.351802 779 consensus_queue.cc:1035] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.354349 763 consensus_queue.cc:1035] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.387796 758 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.389514 773 raft_consensus.cc:979] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: : Instructing follower 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:32.389628 773 raft_consensus.cc:1067] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Signalling peer 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:32.390137 529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0a74432272ce4679a526957941139df0"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:50486
I20240503 08:00:32.390630 529 raft_consensus.cc:482] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:32.390640 773 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.390722 529 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.392001 529 raft_consensus.cc:504] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.392382 529 leader_election.cc:288] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:32.392558 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:32.392655 605 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.392834 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:32.392933 681 raft_consensus.cc:3032] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:32.392973 681 raft_consensus.cc:729] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:32.393095 681 consensus_queue.cc:260] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.393244 681 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.393463 605 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:32.393724 496 leader_election.cc:302] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:32.393869 735 raft_consensus.cc:2781] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:32.393931 735 raft_consensus.cc:686] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:32.394045 735 consensus_queue.cc:237] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.394119 681 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:32.395181 426 catalog_manager.cc:5484] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 1 to 2, leader changed from d65518aba2604740a74c710b546f1daa (127.0.99.3) to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:32.466071 735 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.468619 730 consensus_queue.cc:1035] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.469362 763 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.471206 763 raft_consensus.cc:979] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:32.471292 763 raft_consensus.cc:1067] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:32.471621 727 consensus_queue.cc:1035] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.471740 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35166
I20240503 08:00:32.471825 605 raft_consensus.cc:482] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:32.471895 605 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.472896 605 raft_consensus.cc:504] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.473239 605 leader_election.cc:288] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 2 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:32.473723 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:32.473773 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:32.473830 680 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.473879 529 raft_consensus.cc:3032] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:32.473927 529 raft_consensus.cc:729] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:32.474056 529 consensus_queue.cc:260] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.474182 529 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.474622 680 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 2.
I20240503 08:00:32.474843 529 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 2.
I20240503 08:00:32.474869 570 leader_election.cc:302] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:32.474998 730 raft_consensus.cc:2781] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:32.475080 730 raft_consensus.cc:686] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:32.475194 730 consensus_queue.cc:237] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:32.476543 426 catalog_manager.cc:5484] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 1 to 2, leader changed from 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 2 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:32.482885 730 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.485284 783 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.487171 730 raft_consensus.cc:979] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:32.487257 730 raft_consensus.cc:1067] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Signalling peer 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:32.487619 529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:50502
I20240503 08:00:32.487728 529 raft_consensus.cc:482] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:32.487799 529 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.488688 529 raft_consensus.cc:504] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:32.488977 529 leader_election.cc:288] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Requested vote from peers d65518aba2604740a74c710b546f1daa (127.0.99.3:33723), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:32.489202 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:32.489303 680 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.489341 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:32.489441 605 raft_consensus.cc:3032] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:32.489485 605 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:32.489607 605 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:32.489755 605 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:32.490083 680 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:32.490312 494 leader_election.cc:302] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:32.490448 735 raft_consensus.cc:2781] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:32.490484 605 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:32.490515 735 raft_consensus.cc:686] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:32.490661 735 consensus_queue.cc:237] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:32.491827 424 catalog_manager.cc:5484] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 1 to 2, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:32.670167 680 raft_consensus.cc:1261] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.670588 735 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.672801 605 raft_consensus.cc:1261] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.673208 735 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.796241 529 raft_consensus.cc:1261] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.796648 730 consensus_queue.cc:1035] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.798550 680 raft_consensus.cc:1261] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.798942 727 consensus_queue.cc:1035] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:32.815110 680 raft_consensus.cc:1261] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.815481 735 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.817651 605 raft_consensus.cc:1261] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.818110 763 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.819494 529 raft_consensus.cc:1261] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.819837 773 consensus_queue.cc:1035] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.821833 605 raft_consensus.cc:1261] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.822111 773 consensus_queue.cc:1035] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.888840 529 raft_consensus.cc:1261] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.889271 730 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.892174 680 raft_consensus.cc:1261] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.892462 730 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.971635 605 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.972074 763 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:32.975157 680 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:32.975668 763 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:35.022619 396 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240503 08:00:35.022827 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:35.027403 605 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:35178
I20240503 08:00:35.027587 605 raft_consensus.cc:595] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Received request to transfer leadership to TS d65518aba2604740a74c710b546f1daa
I20240503 08:00:35.031252 529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
mode: GRACEFUL
new_leader_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:50526
I20240503 08:00:35.031389 529 raft_consensus.cc:595] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Received request to transfer leadership to TS d65518aba2604740a74c710b546f1daa
I20240503 08:00:35.031694 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240503 08:00:35.031893 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:35.326790 779 raft_consensus.cc:979] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: : Instructing follower d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:35.326895 779 raft_consensus.cc:1067] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Signalling peer d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:35.327280 680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:43038
I20240503 08:00:35.327464 680 raft_consensus.cc:482] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:35.327535 680 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:35.347666 680 raft_consensus.cc:504] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:35.348157 680 leader_election.cc:288] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 3 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:35.348603 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:35.348603 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:35.348773 605 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:35.348773 529 raft_consensus.cc:3032] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:00:35.348841 529 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:35.349030 529 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:35.349207 529 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:35.354423 529 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 3.
I20240503 08:00:35.354423 605 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 3.
I20240503 08:00:35.354854 647 leader_election.cc:302] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:35.355020 758 raft_consensus.cc:2781] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:00:35.355222 758 raft_consensus.cc:686] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:35.355393 758 consensus_queue.cc:237] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:35.357101 426 catalog_manager.cc:5484] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 2 to 3, leader changed from 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1) to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 3 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:35.416390 796 raft_consensus.cc:979] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:35.416499 796 raft_consensus.cc:1067] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Signalling peer d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:35.417006 681 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:43024
I20240503 08:00:35.417165 681 raft_consensus.cc:482] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:35.417224 681 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:35.420396 681 raft_consensus.cc:504] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:35.420799 681 leader_election.cc:288] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 3 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:35.421137 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:35.421137 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:35.421288 529 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:35.421288 605 raft_consensus.cc:3032] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:00:35.421355 605 raft_consensus.cc:729] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:35.421499 605 consensus_queue.cc:260] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:35.421671 605 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:35.426285 529 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 3.
I20240503 08:00:35.426285 605 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 3.
I20240503 08:00:35.426664 647 leader_election.cc:302] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:35.426846 758 raft_consensus.cc:2781] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:00:35.426936 758 raft_consensus.cc:686] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:35.427089 758 consensus_queue.cc:237] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:35.428828 426 catalog_manager.cc:5484] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 2 to 3, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 3 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:35.814668 529 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:35.815033 758 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:35.817446 605 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:35.817806 811 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:35.845633 529 raft_consensus.cc:1261] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:35.846041 811 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:35.848721 605 raft_consensus.cc:1261] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:35.849069 801 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:36.032169 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:36.033035 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:36.033114 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:37.033475 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:37.034408 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:37.034492 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:38.034778 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:38.035677 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:38.035769 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:39.036041 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:39.036942 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:39.037032 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:40.037294 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:40.038158 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:40.038251 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:41.038530 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:41.039391 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:41.039502 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:42.039775 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:42.040611 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:42.040696 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:43.041019 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:43.042042 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:43.042135 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:44.042466 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:44.043888 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:44.044010 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:45.051136 396 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240503 08:00:45.052436 680 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:43044
I20240503 08:00:45.052580 680 raft_consensus.cc:595] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:45.053705 529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:50516
I20240503 08:00:45.053817 529 raft_consensus.cc:595] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:45.054944 529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:50516
I20240503 08:00:45.055043 529 raft_consensus.cc:595] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:45.056166 529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0a74432272ce4679a526957941139df0"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:50516
I20240503 08:00:45.056267 529 raft_consensus.cc:595] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:45.059254 680 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
mode: GRACEFUL
new_leader_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:43044
I20240503 08:00:45.059348 680 raft_consensus.cc:595] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Received request to transfer leadership to TS 85f49d291abb4177b0d513974a35fa9e
I20240503 08:00:45.102577 779 raft_consensus.cc:979] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.102696 820 raft_consensus.cc:1067] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.103116 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0a74432272ce4679a526957941139df0"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35166
I20240503 08:00:45.103230 605 raft_consensus.cc:482] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:45.103287 605 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:45.104133 605 raft_consensus.cc:504] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.104458 605 leader_election.cc:288] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 3 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:45.104756 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:45.104784 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:45.104866 529 raft_consensus.cc:3032] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:00:45.104889 680 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:45.104912 529 raft_consensus.cc:729] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:45.105065 529 consensus_queue.cc:260] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.105230 529 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:45.105734 680 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 3.
I20240503 08:00:45.105944 529 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 3.
I20240503 08:00:45.106108 570 leader_election.cc:302] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:45.106271 796 raft_consensus.cc:2781] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:00:45.106506 796 raft_consensus.cc:686] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:45.106722 796 consensus_queue.cc:237] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.108183 426 catalog_manager.cc:5484] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 2 to 3, leader changed from 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 3 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:45.191308 811 raft_consensus.cc:979] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.191409 811 raft_consensus.cc:1067] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.191815 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35154
I20240503 08:00:45.191951 605 raft_consensus.cc:482] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:45.192021 605 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:45.192801 605 raft_consensus.cc:504] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:45.193130 605 leader_election.cc:288] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 4 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:45.193379 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:45.193379 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:45.193527 529 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:45.193527 680 raft_consensus.cc:3032] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:00:45.193595 680 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:45.193754 680 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:45.193915 680 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:45.194461 529 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 4.
I20240503 08:00:45.194725 680 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 4.
I20240503 08:00:45.194720 572 leader_election.cc:302] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:45.194901 796 raft_consensus.cc:2781] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:00:45.194988 796 raft_consensus.cc:686] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:45.195115 796 consensus_queue.cc:237] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:45.196470 426 catalog_manager.cc:5484] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 3 to 4, leader changed from d65518aba2604740a74c710b546f1daa (127.0.99.3) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 4 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:45.251513 779 raft_consensus.cc:979] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.251631 779 raft_consensus.cc:1067] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.252045 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35166
I20240503 08:00:45.252169 605 raft_consensus.cc:482] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:45.252230 605 raft_consensus.cc:3037] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:45.253015 605 raft_consensus.cc:504] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.253350 605 leader_election.cc:288] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 2 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:45.253600 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:45.253672 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c719d1676a3f472e95ebc9f89270b2c8" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:45.253715 529 raft_consensus.cc:3032] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:45.253767 529 raft_consensus.cc:729] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:45.253778 680 raft_consensus.cc:3037] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:45.253904 529 consensus_queue.cc:260] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.254065 529 raft_consensus.cc:3037] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:45.254539 680 raft_consensus.cc:2454] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 2.
I20240503 08:00:45.254784 570 leader_election.cc:302] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:45.254807 529 raft_consensus.cc:2454] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 2.
I20240503 08:00:45.254964 796 raft_consensus.cc:2781] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:45.255046 796 raft_consensus.cc:686] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:45.255172 796 consensus_queue.cc:237] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.256657 426 catalog_manager.cc:5484] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 1 to 2, leader changed from 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 2 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:45.285205 820 raft_consensus.cc:979] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.285308 820 raft_consensus.cc:1067] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.285686 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35166
I20240503 08:00:45.285821 605 raft_consensus.cc:482] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:45.285866 605 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:45.286641 605 raft_consensus.cc:504] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.286965 605 leader_election.cc:288] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 3 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:45.287245 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:45.287278 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:45.287357 680 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:45.287379 529 raft_consensus.cc:3032] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:00:45.287447 529 raft_consensus.cc:729] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:45.287600 529 consensus_queue.cc:260] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.287777 529 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:45.288231 680 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 3.
I20240503 08:00:45.288429 529 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 3.
I20240503 08:00:45.288466 570 leader_election.cc:302] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:45.288609 796 raft_consensus.cc:2781] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:00:45.288687 796 raft_consensus.cc:686] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:45.288813 796 consensus_queue.cc:237] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.290202 426 catalog_manager.cc:5484] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 2 to 3, leader changed from 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 3 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:45.484639 529 raft_consensus.cc:1261] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:45.484998 796 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:45.487818 680 raft_consensus.cc:1261] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:45.488143 833 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:45.489989 827 raft_consensus.cc:979] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: : Instructing follower 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.490075 827 raft_consensus.cc:1067] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Signalling peer 85f49d291abb4177b0d513974a35fa9e to start an election
I20240503 08:00:45.490391 605 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
from {username='slave'} at 127.0.0.1:35154
I20240503 08:00:45.490489 605 raft_consensus.cc:482] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:45.490541 605 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:45.491500 605 raft_consensus.cc:504] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.491794 605 leader_election.cc:288] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 4 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:45.492012 529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:45.492107 529 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:45.492161 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726d5dadaf9340668a0412e2154d24da" candidate_uuid: "85f49d291abb4177b0d513974a35fa9e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:45.492252 680 raft_consensus.cc:3032] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:00:45.492277 680 raft_consensus.cc:729] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:45.492370 680 consensus_queue.cc:260] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.492472 680 raft_consensus.cc:3037] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:45.492760 529 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 4.
I20240503 08:00:45.492991 572 leader_election.cc:302] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, 85f49d291abb4177b0d513974a35fa9e; no voters:
I20240503 08:00:45.493121 680 raft_consensus.cc:2454] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f49d291abb4177b0d513974a35fa9e in term 4.
I20240503 08:00:45.493126 833 raft_consensus.cc:2781] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:00:45.493253 833 raft_consensus.cc:686] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Becoming Leader. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:45.493373 833 consensus_queue.cc:237] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:45.494549 424 catalog_manager.cc:5484] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e reported cstate change: term changed from 3 to 4, leader changed from d65518aba2604740a74c710b546f1daa (127.0.99.3) to 85f49d291abb4177b0d513974a35fa9e (127.0.99.2). New cstate: current_term: 4 leader_uuid: "85f49d291abb4177b0d513974a35fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:45.572643 529 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:45.573009 833 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:45.575604 680 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:45.575946 833 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:45.688184 529 raft_consensus.cc:1261] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:45.688597 833 consensus_queue.cc:1035] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:45.691159 680 raft_consensus.cc:1261] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:45.692018 821 consensus_queue.cc:1035] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:45.739109 529 raft_consensus.cc:1261] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:45.739563 821 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:45.741956 680 raft_consensus.cc:1261] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:45.742323 796 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:46.055122 529 raft_consensus.cc:1261] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:46.055608 821 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:46.057823 680 raft_consensus.cc:1261] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Refusing update from remote peer 85f49d291abb4177b0d513974a35fa9e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:46.058163 833 consensus_queue.cc:1035] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:48.066795 396 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240503 08:00:48.066948 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:48.068128 605 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0a74432272ce4679a526957941139df0"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:35178
I20240503 08:00:48.068256 605 raft_consensus.cc:595] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Received request to transfer leadership to TS 57fdf9221a974ac0ab6ec530086fce91
I20240503 08:00:48.068861 605 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:35178
I20240503 08:00:48.068962 605 raft_consensus.cc:595] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Received request to transfer leadership to TS 57fdf9221a974ac0ab6ec530086fce91
I20240503 08:00:48.069530 605 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:35178
I20240503 08:00:48.069617 605 raft_consensus.cc:595] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Received request to transfer leadership to TS d65518aba2604740a74c710b546f1daa
I20240503 08:00:48.070155 605 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:35178
I20240503 08:00:48.070245 605 raft_consensus.cc:595] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Received request to transfer leadership to TS d65518aba2604740a74c710b546f1daa
I20240503 08:00:48.070763 605 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd"
dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
mode: GRACEFUL
new_leader_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:35178
I20240503 08:00:48.070853 605 raft_consensus.cc:595] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Received request to transfer leadership to TS 57fdf9221a974ac0ab6ec530086fce91
I20240503 08:00:48.071091 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240503 08:00:48.071175 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:48.080090 847 raft_consensus.cc:979] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:48.080173 847 raft_consensus.cc:1067] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Signalling peer 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:48.080495 529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:50502
I20240503 08:00:48.080600 529 raft_consensus.cc:482] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:48.080646 529 raft_consensus.cc:3037] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:48.081490 529 raft_consensus.cc:504] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.081851 529 leader_election.cc:288] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:48.082108 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:48.082130 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa584eb4aafd4861b946c541bfc59edd" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:48.082209 605 raft_consensus.cc:3032] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:48.082228 680 raft_consensus.cc:3037] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:48.082250 605 raft_consensus.cc:729] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:48.082386 605 consensus_queue.cc:260] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.082525 605 raft_consensus.cc:3037] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:48.082981 680 raft_consensus.cc:2454] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:48.083230 605 raft_consensus.cc:2454] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 2.
I20240503 08:00:48.083230 494 leader_election.cc:302] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:48.083534 848 raft_consensus.cc:2781] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:48.083690 848 raft_consensus.cc:686] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:48.083835 848 consensus_queue.cc:237] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.085207 424 catalog_manager.cc:5484] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 1 to 2, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:48.090447 846 raft_consensus.cc:979] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:48.090523 846 raft_consensus.cc:1067] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Signalling peer 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:48.091049 529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0a74432272ce4679a526957941139df0"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:50502
I20240503 08:00:48.091148 529 raft_consensus.cc:482] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:48.091204 529 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:48.091948 529 raft_consensus.cc:504] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.092231 529 leader_election.cc:288] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 4 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:48.092486 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:48.092603 605 raft_consensus.cc:3032] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:00:48.092628 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a74432272ce4679a526957941139df0" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:48.092651 605 raft_consensus.cc:729] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:48.092700 680 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:48.092777 605 consensus_queue.cc:260] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.092928 605 raft_consensus.cc:3037] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:48.093575 680 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 4.
I20240503 08:00:48.093667 605 raft_consensus.cc:2454] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 4.
I20240503 08:00:48.093858 494 leader_election.cc:302] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:48.094040 848 raft_consensus.cc:2781] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:00:48.094130 848 raft_consensus.cc:686] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:48.094270 848 consensus_queue.cc:237] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.095614 424 catalog_manager.cc:5484] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 3 to 4, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 4 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:48.278295 847 raft_consensus.cc:979] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:48.278401 847 raft_consensus.cc:1067] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Signalling peer d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:48.278827 680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:43024
I20240503 08:00:48.278980 680 raft_consensus.cc:482] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:48.279045 680 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:48.280057 680 raft_consensus.cc:504] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.280488 680 leader_election.cc:288] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 3 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:48.280794 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:48.280830 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7f163804b59413c9b6aea12230aea1e" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:48.280894 530 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:48.280928 605 raft_consensus.cc:3032] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:00:48.280975 605 raft_consensus.cc:729] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:48.281101 605 consensus_queue.cc:260] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.281239 605 raft_consensus.cc:3037] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:00:48.281667 530 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 3.
I20240503 08:00:48.281934 605 raft_consensus.cc:2454] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 3.
I20240503 08:00:48.281944 647 leader_election.cc:302] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:48.282100 827 raft_consensus.cc:2781] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:00:48.282303 827 raft_consensus.cc:686] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:48.282431 827 consensus_queue.cc:237] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.283787 424 catalog_manager.cc:5484] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 2 to 3, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 3 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:48.522306 846 raft_consensus.cc:979] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:48.522433 846 raft_consensus.cc:1067] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Signalling peer d65518aba2604740a74c710b546f1daa to start an election
I20240503 08:00:48.522828 680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f321fdb898064435a536dbc460609fd5"
dest_uuid: "d65518aba2604740a74c710b546f1daa"
from {username='slave'} at 127.0.0.1:43024
I20240503 08:00:48.522958 680 raft_consensus.cc:482] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:48.523027 680 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:00:48.523838 680 raft_consensus.cc:504] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:48.524160 680 leader_election.cc:288] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 5 election: Requested vote from peers 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061), 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631)
I20240503 08:00:48.524477 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:48.524586 605 raft_consensus.cc:3032] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Stepping down as leader of term 4
I20240503 08:00:48.524623 605 raft_consensus.cc:729] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:48.524632 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f321fdb898064435a536dbc460609fd5" candidate_uuid: "d65518aba2604740a74c710b546f1daa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
I20240503 08:00:48.524706 530 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:00:48.524771 605 consensus_queue.cc:260] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:48.524933 605 raft_consensus.cc:3037] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:00:48.525094 847 raft_consensus.cc:979] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: : Instructing follower 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:48.525183 847 raft_consensus.cc:1067] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Signalling peer 57fdf9221a974ac0ab6ec530086fce91 to start an election
I20240503 08:00:48.525563 530 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 5.
I20240503 08:00:48.525601 529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4"
dest_uuid: "57fdf9221a974ac0ab6ec530086fce91"
from {username='slave'} at 127.0.0.1:50502
I20240503 08:00:48.525678 605 raft_consensus.cc:2454] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d65518aba2604740a74c710b546f1daa in term 5.
I20240503 08:00:48.525705 529 raft_consensus.cc:482] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:48.525753 529 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:48.525897 647 leader_election.cc:302] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f49d291abb4177b0d513974a35fa9e, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:48.526032 827 raft_consensus.cc:2781] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 5 FOLLOWER]: Leader election won for term 5
I20240503 08:00:48.526113 827 raft_consensus.cc:686] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 5 LEADER]: Becoming Leader. State: Replica: d65518aba2604740a74c710b546f1daa, State: Running, Role: LEADER
I20240503 08:00:48.526239 827 consensus_queue.cc:237] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } }
I20240503 08:00:48.526564 529 raft_consensus.cc:504] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.526898 529 leader_election.cc:288] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 4 election: Requested vote from peers 85f49d291abb4177b0d513974a35fa9e (127.0.99.2:36631), d65518aba2604740a74c710b546f1daa (127.0.99.3:33723)
I20240503 08:00:48.527256 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d65518aba2604740a74c710b546f1daa"
I20240503 08:00:48.527355 680 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:48.527400 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d787805bbd574e288a8d553c20837dd4" candidate_uuid: "57fdf9221a974ac0ab6ec530086fce91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85f49d291abb4177b0d513974a35fa9e"
I20240503 08:00:48.527523 605 raft_consensus.cc:3032] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:00:48.527568 605 raft_consensus.cc:729] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f49d291abb4177b0d513974a35fa9e, State: Running, Role: LEADER
I20240503 08:00:48.527684 605 consensus_queue.cc:260] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.527853 605 raft_consensus.cc:3037] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:00:48.527803 424 catalog_manager.cc:5484] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa reported cstate change: term changed from 4 to 5, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to d65518aba2604740a74c710b546f1daa (127.0.99.3). New cstate: current_term: 5 leader_uuid: "d65518aba2604740a74c710b546f1daa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:48.528167 680 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 4.
I20240503 08:00:48.528391 494 leader_election.cc:302] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57fdf9221a974ac0ab6ec530086fce91, d65518aba2604740a74c710b546f1daa; no voters:
I20240503 08:00:48.528539 848 raft_consensus.cc:2781] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:00:48.528613 848 raft_consensus.cc:686] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 LEADER]: Becoming Leader. State: Replica: 57fdf9221a974ac0ab6ec530086fce91, State: Running, Role: LEADER
I20240503 08:00:48.528640 605 raft_consensus.cc:2454] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57fdf9221a974ac0ab6ec530086fce91 in term 4.
I20240503 08:00:48.528833 848 consensus_queue.cc:237] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } }
I20240503 08:00:48.530261 426 catalog_manager.cc:5484] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 reported cstate change: term changed from 3 to 4, leader changed from 85f49d291abb4177b0d513974a35fa9e (127.0.99.2) to 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1). New cstate: current_term: 4 leader_uuid: "57fdf9221a974ac0ab6ec530086fce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:48.598757 605 raft_consensus.cc:1261] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:48.599171 848 consensus_queue.cc:1035] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:48.601485 680 raft_consensus.cc:1261] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:48.601816 848 consensus_queue.cc:1035] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:48.657250 680 raft_consensus.cc:1261] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:48.657656 848 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:48.659844 605 raft_consensus.cc:1261] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:48.660177 849 consensus_queue.cc:1035] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:48.687551 605 raft_consensus.cc:1261] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:48.687937 827 consensus_queue.cc:1035] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:48.690104 529 raft_consensus.cc:1261] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:00:48.690450 856 consensus_queue.cc:1035] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:00:48.969030 680 raft_consensus.cc:1261] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:48.969375 849 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d65518aba2604740a74c710b546f1daa" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:48.971536 605 raft_consensus.cc:1261] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Refusing update from remote peer 57fdf9221a974ac0ab6ec530086fce91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:00:48.971940 849 consensus_queue.cc:1035] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:00:49.012961 529 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 5 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 08:00:49.013358 856 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "57fdf9221a974ac0ab6ec530086fce91" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 08:00:49.015652 605 raft_consensus.cc:1261] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 5 FOLLOWER]: Refusing update from remote peer d65518aba2604740a74c710b546f1daa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 08:00:49.016587 873 consensus_queue.cc:1035] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f49d291abb4177b0d513974a35fa9e" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 36631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 08:00:49.071511 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:49.072367 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:49.072440 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:50.072677 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:50.073632 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:50.073714 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:51.073992 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:51.074829 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:51.074899 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:52.075208 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:52.076119 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:52.076196 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:53.076496 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:53.077454 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:53.077540 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:54.077869 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:54.079180 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:54.079275 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:55.079634 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:55.080797 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:55.080893 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:56.081205 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:56.082088 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:56.082178 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:57.082435 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:00:57.083310 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:00:57.083397 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:00:58.090247 396 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240503 08:00:58.090451 396 tablet_server.cc:178] TabletServer@127.0.99.1:0 shutting down...
W20240503 08:00:58.095360 647 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20240503 08:00:58.095371 396 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:00:58.095654 396 tablet_replica.cc:330] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.096154 396 raft_consensus.cc:2229] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Raft consensus shutting down.
W20240503 08:00:58.096168 647 consensus_peers.cc:485] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa -> Peer 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061): Couldn't send request to peer 57fdf9221a974ac0ab6ec530086fce91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:00:58.096343 396 raft_consensus.cc:2258] T f7f163804b59413c9b6aea12230aea1e P 57fdf9221a974ac0ab6ec530086fce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.097256 396 tablet_replica.cc:330] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.097352 396 raft_consensus.cc:2229] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.097496 396 raft_consensus.cc:2258] T 0a74432272ce4679a526957941139df0 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.097800 396 tablet_replica.cc:330] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.097884 396 raft_consensus.cc:2229] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.097967 396 raft_consensus.cc:2258] T f321fdb898064435a536dbc460609fd5 P 57fdf9221a974ac0ab6ec530086fce91 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.098237 396 tablet_replica.cc:330] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.098315 396 raft_consensus.cc:2229] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.098445 396 raft_consensus.cc:2258] T fa584eb4aafd4861b946c541bfc59edd P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.098709 396 tablet_replica.cc:330] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.098789 396 raft_consensus.cc:2229] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.098871 396 raft_consensus.cc:2258] T 726d5dadaf9340668a0412e2154d24da P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.099130 396 tablet_replica.cc:330] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.099206 396 raft_consensus.cc:2229] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.099331 396 raft_consensus.cc:2258] T d787805bbd574e288a8d553c20837dd4 P 57fdf9221a974ac0ab6ec530086fce91 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.099634 396 tablet_replica.cc:330] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.099725 396 raft_consensus.cc:2229] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.099805 396 raft_consensus.cc:2258] T c719d1676a3f472e95ebc9f89270b2c8 P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.100073 396 tablet_replica.cc:330] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.100145 396 raft_consensus.cc:2229] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.100225 396 raft_consensus.cc:2258] T f1f903fa33564e05aacaa03f3e85876f P 57fdf9221a974ac0ab6ec530086fce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.100476 396 tablet_replica.cc:330] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91: stopping tablet replica
I20240503 08:00:58.100545 396 raft_consensus.cc:2229] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.100625 396 raft_consensus.cc:2258] T e19772cba389428380be034490247369 P 57fdf9221a974ac0ab6ec530086fce91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20240503 08:00:58.107311 572 consensus_peers.cc:485] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e -> Peer 57fdf9221a974ac0ab6ec530086fce91 (127.0.99.1:44061): Couldn't send request to peer 57fdf9221a974ac0ab6ec530086fce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.99.1:44061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240503 08:00:58.114931 396 tablet_server.cc:194] TabletServer@127.0.99.1:0 shutdown complete.
I20240503 08:00:58.119150 396 tablet_server.cc:178] TabletServer@127.0.99.2:0 shutting down...
I20240503 08:00:58.123090 396 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:00:58.123252 396 tablet_replica.cc:330] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.123373 396 raft_consensus.cc:2229] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.123515 396 raft_consensus.cc:2258] T f1f903fa33564e05aacaa03f3e85876f P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.123891 396 tablet_replica.cc:330] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.123982 396 raft_consensus.cc:2229] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.124076 396 raft_consensus.cc:2258] T 0a74432272ce4679a526957941139df0 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.124359 396 tablet_replica.cc:330] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.124431 396 raft_consensus.cc:2229] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.124496 396 raft_consensus.cc:2258] T d787805bbd574e288a8d553c20837dd4 P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.124751 396 tablet_replica.cc:330] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.124819 396 raft_consensus.cc:2229] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.124956 396 raft_consensus.cc:2258] T 726d5dadaf9340668a0412e2154d24da P 85f49d291abb4177b0d513974a35fa9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.125226 396 tablet_replica.cc:330] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.125317 396 raft_consensus.cc:2229] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.125402 396 raft_consensus.cc:2258] T f321fdb898064435a536dbc460609fd5 P 85f49d291abb4177b0d513974a35fa9e [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.125737 396 tablet_replica.cc:330] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.125826 396 raft_consensus.cc:2229] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.125909 396 raft_consensus.cc:2258] T f7f163804b59413c9b6aea12230aea1e P 85f49d291abb4177b0d513974a35fa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.126214 396 tablet_replica.cc:330] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.126286 396 raft_consensus.cc:2229] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.126369 396 raft_consensus.cc:2258] T fa584eb4aafd4861b946c541bfc59edd P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.126626 396 tablet_replica.cc:330] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.126695 396 raft_consensus.cc:2229] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.126832 396 raft_consensus.cc:2258] T c719d1676a3f472e95ebc9f89270b2c8 P 85f49d291abb4177b0d513974a35fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.127106 396 tablet_replica.cc:330] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e: stopping tablet replica
I20240503 08:00:58.127173 396 raft_consensus.cc:2229] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.127308 396 raft_consensus.cc:2258] T e19772cba389428380be034490247369 P 85f49d291abb4177b0d513974a35fa9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.140417 396 tablet_server.cc:194] TabletServer@127.0.99.2:0 shutdown complete.
I20240503 08:00:58.142649 396 tablet_server.cc:178] TabletServer@127.0.99.3:0 shutting down...
I20240503 08:00:58.146338 396 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:00:58.146490 396 tablet_replica.cc:330] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.146598 396 raft_consensus.cc:2229] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.146692 396 raft_consensus.cc:2258] T e19772cba389428380be034490247369 P d65518aba2604740a74c710b546f1daa [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.147040 396 tablet_replica.cc:330] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.147114 396 raft_consensus.cc:2229] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.147186 396 raft_consensus.cc:2258] T fa584eb4aafd4861b946c541bfc59edd P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.147465 396 tablet_replica.cc:330] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.147545 396 raft_consensus.cc:2229] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.147615 396 raft_consensus.cc:2258] T c719d1676a3f472e95ebc9f89270b2c8 P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.147864 396 tablet_replica.cc:330] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.147930 396 raft_consensus.cc:2229] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 5 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.148075 396 raft_consensus.cc:2258] T f321fdb898064435a536dbc460609fd5 P d65518aba2604740a74c710b546f1daa [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.148316 396 tablet_replica.cc:330] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.148378 396 raft_consensus.cc:2229] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.148487 396 raft_consensus.cc:2258] T f7f163804b59413c9b6aea12230aea1e P d65518aba2604740a74c710b546f1daa [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.148738 396 tablet_replica.cc:330] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.148800 396 raft_consensus.cc:2229] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.148864 396 raft_consensus.cc:2258] T 726d5dadaf9340668a0412e2154d24da P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.149093 396 tablet_replica.cc:330] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.149152 396 raft_consensus.cc:2229] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.149216 396 raft_consensus.cc:2258] T d787805bbd574e288a8d553c20837dd4 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.149439 396 tablet_replica.cc:330] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.149497 396 raft_consensus.cc:2229] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.149616 396 raft_consensus.cc:2258] T f1f903fa33564e05aacaa03f3e85876f P d65518aba2604740a74c710b546f1daa [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.149844 396 tablet_replica.cc:330] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa: stopping tablet replica
I20240503 08:00:58.149901 396 raft_consensus.cc:2229] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:00:58.149967 396 raft_consensus.cc:2258] T 0a74432272ce4679a526957941139df0 P d65518aba2604740a74c710b546f1daa [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.162832 396 tablet_server.cc:194] TabletServer@127.0.99.3:0 shutdown complete.
I20240503 08:00:58.165262 396 master.cc:537] Master@127.0.99.62:37461 shutting down...
I20240503 08:00:58.168473 396 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:00:58.168607 396 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:00:58.168670 396 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2bec411dfd9340979b5e687f7763f705: stopping tablet replica
I20240503 08:00:58.180727 396 master.cc:552] Master@127.0.99.62:37461 shutdown complete.
57fdf9221a974ac0ab6ec530086fce91 4
85f49d291abb4177b0d513974a35fa9e 4
d65518aba2604740a74c710b546f1daa 1
57fdf9221a974ac0ab6ec530086fce91 3
85f49d291abb4177b0d513974a35fa9e 3
d65518aba2604740a74c710b546f1daa 3
57fdf9221a974ac0ab6ec530086fce91 0
85f49d291abb4177b0d513974a35fa9e 8
d65518aba2604740a74c710b546f1daa 1
57fdf9221a974ac0ab6ec530086fce91 3
85f49d291abb4177b0d513974a35fa9e 3
d65518aba2604740a74c710b546f1daa 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (26735 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240503 08:00:58.190049 396 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.99.62:36571
I20240503 08:00:58.190351 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:00:58.193058 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.193709 396 server_base.cc:1034] running on GCE node
W20240503 08:00:58.194401 881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:58.194916 880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.195111 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:58.195154 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:58.195168 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723258195168 us; error 0 us; skew 500 ppm
I20240503 08:00:58.199956 396 webserver.cc:460] Webserver started at http://127.0.99.62:34281/ using document root <none> and password file <none>
I20240503 08:00:58.200086 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:58.200126 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:58.200179 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:58.200505 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/master-0-root/instance:
uuid: "ae3e2f0e03e245db8468d9afb8b40455"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.201802 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.202579 888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.202803 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.202872 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/master-0-root
uuid: "ae3e2f0e03e245db8468d9afb8b40455"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.202952 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:58.209970 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:58.210233 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:58.213771 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.62:36571
I20240503 08:00:58.217108 940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.62:36571 every 8 connection(s)
I20240503 08:00:58.217542 941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.219141 941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455: Bootstrap starting.
I20240503 08:00:58.219903 941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.220757 941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455: No bootstrap required, opened a new log
I20240503 08:00:58.221110 941 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae3e2f0e03e245db8468d9afb8b40455" member_type: VOTER }
I20240503 08:00:58.221194 941 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.221223 941 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae3e2f0e03e245db8468d9afb8b40455, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.221339 941 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae3e2f0e03e245db8468d9afb8b40455" member_type: VOTER }
I20240503 08:00:58.221402 941 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:00:58.221439 941 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:00:58.221482 941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.222090 941 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae3e2f0e03e245db8468d9afb8b40455" member_type: VOTER }
I20240503 08:00:58.222204 941 leader_election.cc:302] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae3e2f0e03e245db8468d9afb8b40455; no voters:
I20240503 08:00:58.222352 941 leader_election.cc:288] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:00:58.222429 944 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.222622 944 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 1 LEADER]: Becoming Leader. State: Replica: ae3e2f0e03e245db8468d9afb8b40455, State: Running, Role: LEADER
I20240503 08:00:58.222738 941 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:00:58.222756 944 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae3e2f0e03e245db8468d9afb8b40455" member_type: VOTER }
I20240503 08:00:58.223170 945 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae3e2f0e03e245db8468d9afb8b40455" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae3e2f0e03e245db8468d9afb8b40455" member_type: VOTER } }
I20240503 08:00:58.223205 946 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae3e2f0e03e245db8468d9afb8b40455. Latest consensus state: current_term: 1 leader_uuid: "ae3e2f0e03e245db8468d9afb8b40455" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae3e2f0e03e245db8468d9afb8b40455" member_type: VOTER } }
I20240503 08:00:58.223261 945 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [sys.catalog]: This master's current role is: LEADER
I20240503 08:00:58.223291 946 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [sys.catalog]: This master's current role is: LEADER
I20240503 08:00:58.223762 950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:00:58.224632 950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:00:58.224784 396 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 08:00:58.226167 950 catalog_manager.cc:1347] Generated new cluster ID: 160f683c5d164102b0fd1254e1c223bf
I20240503 08:00:58.226219 950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:00:58.235908 950 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:00:58.236390 950 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:00:58.254272 950 catalog_manager.cc:5857] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455: Generated new TSK 0
I20240503 08:00:58.254455 950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:00:58.256973 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:00:58.259625 962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:58.260236 965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.260870 396 server_base.cc:1034] running on GCE node
W20240503 08:00:58.261421 963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.261621 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:58.261682 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:58.261727 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723258261727 us; error 0 us; skew 500 ppm
I20240503 08:00:58.262619 396 webserver.cc:460] Webserver started at http://127.0.99.1:33367/ using document root <none> and password file <none>
I20240503 08:00:58.262780 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:58.262831 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:58.262907 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:58.263273 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-0-root/instance:
uuid: "632b23a6349a4d009ea42004b6b51640"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.264798 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.265758 970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.265985 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.266054 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-0-root
uuid: "632b23a6349a4d009ea42004b6b51640"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.266124 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:58.276403 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:58.276808 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:58.277118 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:00:58.277580 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:00:58.277622 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.277671 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:00:58.277702 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.281845 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.1:35139
I20240503 08:00:58.281867 1033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.1:35139 every 8 connection(s)
I20240503 08:00:58.282637 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:00:58.285272 1039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:58.285874 1041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:58.286497 1038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.286736 1034 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36571
I20240503 08:00:58.286823 1034 heartbeater.cc:464] Registering TS with master...
I20240503 08:00:58.287073 396 server_base.cc:1034] running on GCE node
I20240503 08:00:58.287087 1034 heartbeater.cc:511] Master 127.0.99.62:36571 requested a full tablet report, sending...
I20240503 08:00:58.287257 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:58.287294 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:58.287315 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723258287314 us; error 0 us; skew 500 ppm
I20240503 08:00:58.287756 905 ts_manager.cc:194] Registered new tserver with Master: 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139)
I20240503 08:00:58.288250 396 webserver.cc:460] Webserver started at http://127.0.99.2:43195/ using document root <none> and password file <none>
I20240503 08:00:58.288394 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:58.288442 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:58.288512 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:58.288486 905 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46328
I20240503 08:00:58.288969 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-1-root/instance:
uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.290306 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20240503 08:00:58.291110 1046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.291333 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.291397 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-1-root
uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.291508 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:58.298852 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:58.299142 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:58.299398 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:00:58.299845 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:00:58.299885 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.299926 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:00:58.299957 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.303884 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.2:39739
I20240503 08:00:58.303922 1109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.2:39739 every 8 connection(s)
I20240503 08:00:58.304697 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:00:58.307241 1113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:00:58.307950 1116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.308319 1110 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36571
I20240503 08:00:58.308414 1110 heartbeater.cc:464] Registering TS with master...
I20240503 08:00:58.308534 396 server_base.cc:1034] running on GCE node
I20240503 08:00:58.308637 1110 heartbeater.cc:511] Master 127.0.99.62:36571 requested a full tablet report, sending...
W20240503 08:00:58.309115 1114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:00:58.309231 905 ts_manager.cc:194] Registered new tserver with Master: 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.309374 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:00:58.309420 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:00:58.309440 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723258309440 us; error 0 us; skew 500 ppm
I20240503 08:00:58.309793 905 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46332
I20240503 08:00:58.310346 396 webserver.cc:460] Webserver started at http://127.0.99.3:36509/ using document root <none> and password file <none>
I20240503 08:00:58.310487 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:00:58.310535 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:00:58.310614 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:00:58.311127 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-2-root/instance:
uuid: "f9dd1504bffd41e8af78249a523a9403"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.312722 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20240503 08:00:58.313588 1121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.313794 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.313867 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-2-root
uuid: "f9dd1504bffd41e8af78249a523a9403"
format_stamp: "Formatted at 2024-05-03 08:00:58 on dist-test-slave-gf01"
I20240503 08:00:58.313941 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723231444759-396-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:00:58.328258 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:00:58.328626 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:00:58.328915 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:00:58.329357 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:00:58.329399 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.329449 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:00:58.329478 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:00:58.334285 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.3:42991
I20240503 08:00:58.334336 1184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.3:42991 every 8 connection(s)
I20240503 08:00:58.338589 1185 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36571
I20240503 08:00:58.338682 1185 heartbeater.cc:464] Registering TS with master...
I20240503 08:00:58.338884 1185 heartbeater.cc:511] Master 127.0.99.62:36571 requested a full tablet report, sending...
I20240503 08:00:58.339468 905 ts_manager.cc:194] Registered new tserver with Master: f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.339996 905 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46342
I20240503 08:00:58.340327 396 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00555326s
I20240503 08:00:58.340822 396 test_util.cc:268] Using random seed: 515085782
I20240503 08:00:58.347620 905 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46350:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 08:00:58.348204 905 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 08:00:58.359597 1149 tablet_service.cc:1467] Processing CreateTablet for tablet ed06dd84f5824f3c92340f5cc43175e8 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 08:00:58.359822 1147 tablet_service.cc:1467] Processing CreateTablet for tablet 127c7f6ea3d342c8aa2d9bb4fc77ba0e (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 08:00:58.359951 1149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed06dd84f5824f3c92340f5cc43175e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.359994 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 963e451b93b44b04a305e4b5f5cd067e (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 08:00:58.360085 1147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 127c7f6ea3d342c8aa2d9bb4fc77ba0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.360303 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 963e451b93b44b04a305e4b5f5cd067e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.360477 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 2cdfaa9f47d54b5fb358f9aeccfc39ac (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 08:00:58.360704 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cdfaa9f47d54b5fb358f9aeccfc39ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.361145 1144 tablet_service.cc:1467] Processing CreateTablet for tablet e18bdba1aeb848009b9c242b845d3eb9 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 08:00:58.361368 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18bdba1aeb848009b9c242b845d3eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.362411 1074 tablet_service.cc:1467] Processing CreateTablet for tablet ed06dd84f5824f3c92340f5cc43175e8 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 08:00:58.362448 1071 tablet_service.cc:1467] Processing CreateTablet for tablet 2cdfaa9f47d54b5fb358f9aeccfc39ac (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 08:00:58.362599 1074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed06dd84f5824f3c92340f5cc43175e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.362706 1200 tablet_bootstrap.cc:492] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.363658 1200 tablet_bootstrap.cc:654] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.363752 1065 tablet_service.cc:1467] Processing CreateTablet for tablet 37841eca10a74ac6b20bbca1751419fe (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 08:00:58.363972 1065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37841eca10a74ac6b20bbca1751419fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.364297 1071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cdfaa9f47d54b5fb358f9aeccfc39ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.364630 1202 tablet_bootstrap.cc:492] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.365281 1200 tablet_bootstrap.cc:492] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.365355 1200 ts_tablet_manager.cc:1367] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:00:58.365507 1202 tablet_bootstrap.cc:654] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.365814 1066 tablet_service.cc:1467] Processing CreateTablet for tablet 963e451b93b44b04a305e4b5f5cd067e (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 08:00:58.366024 1066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 963e451b93b44b04a305e4b5f5cd067e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.366071 1200 raft_consensus.cc:348] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.366171 1200 raft_consensus.cc:374] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.366202 1200 raft_consensus.cc:729] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.366343 1200 consensus_queue.cc:260] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.366441 1202 tablet_bootstrap.cc:492] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.366505 1202 ts_tablet_manager.cc:1367] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:58.366684 1200 ts_tablet_manager.cc:1398] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.366845 1185 heartbeater.cc:503] Master 127.0.99.62:36571 was elected leader, sending a full tablet report...
I20240503 08:00:58.366887 1202 raft_consensus.cc:348] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.367040 1202 raft_consensus.cc:374] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.367074 1202 raft_consensus.cc:729] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.367177 1202 consensus_queue.cc:260] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.367331 1073 tablet_service.cc:1467] Processing CreateTablet for tablet a8e0fa41a45d446ebb6a34130aa184a8 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 08:00:58.367539 1202 ts_tablet_manager.cc:1398] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.367566 1073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e0fa41a45d446ebb6a34130aa184a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.367781 1202 tablet_bootstrap.cc:492] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.367923 1067 tablet_service.cc:1467] Processing CreateTablet for tablet e1263559849a402db75cab636b9e7612 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 08:00:58.368149 1067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1263559849a402db75cab636b9e7612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.368587 1202 tablet_bootstrap.cc:654] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.369109 1110 heartbeater.cc:503] Master 127.0.99.62:36571 was elected leader, sending a full tablet report...
I20240503 08:00:58.366868 1200 tablet_bootstrap.cc:492] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.370028 1068 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf11d78cba347d59218a6babf55f979 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 08:00:58.370154 1200 tablet_bootstrap.cc:654] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.370270 1068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf11d78cba347d59218a6babf55f979. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.370527 1202 tablet_bootstrap.cc:492] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.370600 1202 ts_tablet_manager.cc:1367] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:00:58.371003 1202 raft_consensus.cc:348] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.371089 1202 raft_consensus.cc:374] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.371119 1202 raft_consensus.cc:729] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.371148 1200 tablet_bootstrap.cc:492] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.371207 1200 ts_tablet_manager.cc:1367] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:00:58.371210 1202 consensus_queue.cc:260] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.371484 1202 ts_tablet_manager.cc:1398] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.371618 1202 tablet_bootstrap.cc:492] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.371631 1200 raft_consensus.cc:348] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.371726 1200 raft_consensus.cc:374] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.371755 1200 raft_consensus.cc:729] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.371851 1200 consensus_queue.cc:260] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.372078 1200 ts_tablet_manager.cc:1398] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.372226 1200 tablet_bootstrap.cc:492] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.372412 1070 tablet_service.cc:1467] Processing CreateTablet for tablet 7368bae6cc184be1baf0222034c2b644 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 08:00:58.372501 1202 tablet_bootstrap.cc:654] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.372640 1070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7368bae6cc184be1baf0222034c2b644. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.373009 1200 tablet_bootstrap.cc:654] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.372234 1069 tablet_service.cc:1467] Processing CreateTablet for tablet e18bdba1aeb848009b9c242b845d3eb9 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 08:00:58.373632 1202 tablet_bootstrap.cc:492] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.373693 1202 ts_tablet_manager.cc:1367] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:00:58.373749 1069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18bdba1aeb848009b9c242b845d3eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.374073 1202 raft_consensus.cc:348] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.374151 1202 raft_consensus.cc:374] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.374176 1202 raft_consensus.cc:729] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.374270 1202 consensus_queue.cc:260] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.374485 1202 ts_tablet_manager.cc:1398] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240503 08:00:58.374631 1202 tablet_bootstrap.cc:492] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.374580 1072 tablet_service.cc:1467] Processing CreateTablet for tablet 127c7f6ea3d342c8aa2d9bb4fc77ba0e (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 08:00:58.374815 1072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 127c7f6ea3d342c8aa2d9bb4fc77ba0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.375461 1202 tablet_bootstrap.cc:654] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.375998 1200 tablet_bootstrap.cc:492] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.376068 1200 ts_tablet_manager.cc:1367] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:00:58.376469 1200 raft_consensus.cc:348] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.376546 1202 tablet_bootstrap.cc:492] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.376562 1200 raft_consensus.cc:374] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.376600 1200 raft_consensus.cc:729] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.376613 1202 ts_tablet_manager.cc:1367] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:58.376703 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf11d78cba347d59218a6babf55f979 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 08:00:58.376930 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf11d78cba347d59218a6babf55f979. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.376714 1200 consensus_queue.cc:260] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.377024 1202 raft_consensus.cc:348] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.377104 1202 raft_consensus.cc:374] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.377133 1202 raft_consensus.cc:729] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.377251 1200 ts_tablet_manager.cc:1398] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.377233 1202 consensus_queue.cc:260] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.377442 1202 ts_tablet_manager.cc:1398] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.377575 1202 tablet_bootstrap.cc:492] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.378386 1202 tablet_bootstrap.cc:654] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.378726 1200 tablet_bootstrap.cc:492] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.378790 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 37841eca10a74ac6b20bbca1751419fe (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 08:00:58.379012 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37841eca10a74ac6b20bbca1751419fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.379514 1202 tablet_bootstrap.cc:492] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.379585 1202 ts_tablet_manager.cc:1367] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:58.379624 1200 tablet_bootstrap.cc:654] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.379963 1202 raft_consensus.cc:348] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.380049 1202 raft_consensus.cc:374] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.380079 1202 raft_consensus.cc:729] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.380177 1202 consensus_queue.cc:260] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.380414 1202 ts_tablet_manager.cc:1398] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.380553 1202 tablet_bootstrap.cc:492] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.380678 1200 tablet_bootstrap.cc:492] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.380759 1200 ts_tablet_manager.cc:1367] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:58.380882 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 7368bae6cc184be1baf0222034c2b644 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 08:00:58.381125 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7368bae6cc184be1baf0222034c2b644. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.381168 1200 raft_consensus.cc:348] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.381258 1200 raft_consensus.cc:374] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.381290 1200 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.381361 1202 tablet_bootstrap.cc:654] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.381386 1200 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.381629 1200 ts_tablet_manager.cc:1398] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.381767 1200 tablet_bootstrap.cc:492] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.382532 1202 tablet_bootstrap.cc:492] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.382565 1200 tablet_bootstrap.cc:654] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.382612 1202 ts_tablet_manager.cc:1367] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:58.382834 1142 tablet_service.cc:1467] Processing CreateTablet for tablet e1263559849a402db75cab636b9e7612 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 08:00:58.382993 1202 raft_consensus.cc:348] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.383057 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1263559849a402db75cab636b9e7612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.383078 1202 raft_consensus.cc:374] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.383106 1202 raft_consensus.cc:729] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.383201 1202 consensus_queue.cc:260] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.383452 1202 ts_tablet_manager.cc:1398] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.383586 1202 tablet_bootstrap.cc:492] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.384347 1200 tablet_bootstrap.cc:492] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.384434 1200 ts_tablet_manager.cc:1367] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:00:58.384363 1202 tablet_bootstrap.cc:654] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.359629 1148 tablet_service.cc:1467] Processing CreateTablet for tablet a8e0fa41a45d446ebb6a34130aa184a8 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 08:00:58.384819 1200 raft_consensus.cc:348] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.384907 1200 raft_consensus.cc:374] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.384936 1200 raft_consensus.cc:729] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.384970 1148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e0fa41a45d446ebb6a34130aa184a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.385032 1200 consensus_queue.cc:260] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.385267 1200 ts_tablet_manager.cc:1398] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.385419 1200 tablet_bootstrap.cc:492] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.386271 1200 tablet_bootstrap.cc:654] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.387254 1200 tablet_bootstrap.cc:492] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.387338 1200 ts_tablet_manager.cc:1367] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:58.387602 1202 tablet_bootstrap.cc:492] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.387681 1202 ts_tablet_manager.cc:1367] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:00:58.387759 1200 raft_consensus.cc:348] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.387845 1200 raft_consensus.cc:374] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.387876 1200 raft_consensus.cc:729] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.387996 1200 consensus_queue.cc:260] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.388056 1202 raft_consensus.cc:348] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.388144 1202 raft_consensus.cc:374] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.388175 1202 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.388278 1202 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.388518 1202 ts_tablet_manager.cc:1398] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.388664 1202 tablet_bootstrap.cc:492] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.388770 1200 ts_tablet_manager.cc:1398] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.388918 1200 tablet_bootstrap.cc:492] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.389259 998 tablet_service.cc:1467] Processing CreateTablet for tablet ed06dd84f5824f3c92340f5cc43175e8 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 08:00:58.389492 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed06dd84f5824f3c92340f5cc43175e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.389500 1202 tablet_bootstrap.cc:654] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.390681 1200 tablet_bootstrap.cc:654] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.391424 1219 tablet_bootstrap.cc:492] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.391474 989 tablet_service.cc:1467] Processing CreateTablet for tablet 37841eca10a74ac6b20bbca1751419fe (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 08:00:58.391712 989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37841eca10a74ac6b20bbca1751419fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.391847 997 tablet_service.cc:1467] Processing CreateTablet for tablet a8e0fa41a45d446ebb6a34130aa184a8 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 08:00:58.392069 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e0fa41a45d446ebb6a34130aa184a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.392278 1219 tablet_bootstrap.cc:654] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.391697 1200 tablet_bootstrap.cc:492] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.393440 1200 ts_tablet_manager.cc:1367] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240503 08:00:58.393824 1200 raft_consensus.cc:348] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.393851 996 tablet_service.cc:1467] Processing CreateTablet for tablet 127c7f6ea3d342c8aa2d9bb4fc77ba0e (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 08:00:58.393913 1200 raft_consensus.cc:374] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.393941 1200 raft_consensus.cc:729] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.394065 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 127c7f6ea3d342c8aa2d9bb4fc77ba0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.394042 1200 consensus_queue.cc:260] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.394274 1200 ts_tablet_manager.cc:1398] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.394428 1200 tablet_bootstrap.cc:492] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.395195 1200 tablet_bootstrap.cc:654] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.395809 990 tablet_service.cc:1467] Processing CreateTablet for tablet 963e451b93b44b04a305e4b5f5cd067e (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 08:00:58.396062 990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 963e451b93b44b04a305e4b5f5cd067e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.396126 1200 tablet_bootstrap.cc:492] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.396195 1200 ts_tablet_manager.cc:1367] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:58.396273 1219 tablet_bootstrap.cc:492] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.396332 1219 ts_tablet_manager.cc:1367] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20240503 08:00:58.396561 1200 raft_consensus.cc:348] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.396665 1200 raft_consensus.cc:374] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.396698 1200 raft_consensus.cc:729] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.396723 1219 raft_consensus.cc:348] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.396793 1219 raft_consensus.cc:374] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.396812 1200 consensus_queue.cc:260] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.396821 1219 raft_consensus.cc:729] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.397058 1219 consensus_queue.cc:260] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.397186 995 tablet_service.cc:1467] Processing CreateTablet for tablet 2cdfaa9f47d54b5fb358f9aeccfc39ac (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 08:00:58.397404 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cdfaa9f47d54b5fb358f9aeccfc39ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.397456 1219 ts_tablet_manager.cc:1398] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.397604 1034 heartbeater.cc:503] Master 127.0.99.62:36571 was elected leader, sending a full tablet report...
I20240503 08:00:58.398051 1219 tablet_bootstrap.cc:492] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.397065 1200 ts_tablet_manager.cc:1398] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.398406 1200 tablet_bootstrap.cc:492] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.399055 1219 tablet_bootstrap.cc:654] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.399212 1200 tablet_bootstrap.cc:654] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.399286 994 tablet_service.cc:1467] Processing CreateTablet for tablet 7368bae6cc184be1baf0222034c2b644 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 08:00:58.399540 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7368bae6cc184be1baf0222034c2b644. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.400287 1219 tablet_bootstrap.cc:492] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.400364 1219 ts_tablet_manager.cc:1367] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:58.400708 1219 raft_consensus.cc:348] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.400777 1219 raft_consensus.cc:374] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.400795 1219 raft_consensus.cc:729] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.400879 1219 consensus_queue.cc:260] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.401180 1219 ts_tablet_manager.cc:1398] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.401338 1219 tablet_bootstrap.cc:492] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.401583 991 tablet_service.cc:1467] Processing CreateTablet for tablet e1263559849a402db75cab636b9e7612 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 08:00:58.401808 991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1263559849a402db75cab636b9e7612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.402190 1219 tablet_bootstrap.cc:654] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.402644 1200 tablet_bootstrap.cc:492] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.402721 1200 ts_tablet_manager.cc:1367] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:00:58.402848 993 tablet_service.cc:1467] Processing CreateTablet for tablet e18bdba1aeb848009b9c242b845d3eb9 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 08:00:58.403098 993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18bdba1aeb848009b9c242b845d3eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.403090 1200 raft_consensus.cc:348] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.403189 1200 raft_consensus.cc:374] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.403218 1200 raft_consensus.cc:729] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.403303 992 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf11d78cba347d59218a6babf55f979 (DEFAULT_TABLE table=test-workload [id=61d4cfdcfb054256b2ad676a65e2767b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 08:00:58.403323 1200 consensus_queue.cc:260] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.403740 1200 ts_tablet_manager.cc:1398] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.404250 992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf11d78cba347d59218a6babf55f979. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:00:58.404532 1200 tablet_bootstrap.cc:492] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: Bootstrap starting.
I20240503 08:00:58.404654 1202 tablet_bootstrap.cc:492] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.404728 1202 ts_tablet_manager.cc:1367] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20240503 08:00:58.405124 1202 raft_consensus.cc:348] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.405210 1202 raft_consensus.cc:374] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.405238 1202 raft_consensus.cc:729] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.405261 1219 tablet_bootstrap.cc:492] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.405325 1219 ts_tablet_manager.cc:1367] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:00:58.405359 1200 tablet_bootstrap.cc:654] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.405340 1202 consensus_queue.cc:260] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.405592 1202 ts_tablet_manager.cc:1398] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.405743 1202 tablet_bootstrap.cc:492] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.405721 1219 raft_consensus.cc:348] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.405799 1219 raft_consensus.cc:374] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.405831 1219 raft_consensus.cc:729] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.405926 1219 consensus_queue.cc:260] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.406180 1219 ts_tablet_manager.cc:1398] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.406316 1219 tablet_bootstrap.cc:492] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.406555 1202 tablet_bootstrap.cc:654] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.407058 1200 tablet_bootstrap.cc:492] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: No bootstrap required, opened a new log
I20240503 08:00:58.407142 1200 ts_tablet_manager.cc:1367] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:00:58.407545 1200 raft_consensus.cc:348] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.407645 1200 raft_consensus.cc:374] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.407675 1200 raft_consensus.cc:729] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.407771 1200 consensus_queue.cc:260] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.408022 1200 ts_tablet_manager.cc:1398] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.407145 1219 tablet_bootstrap.cc:654] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.409113 1219 tablet_bootstrap.cc:492] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.409188 1219 ts_tablet_manager.cc:1367] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240503 08:00:58.409543 1219 raft_consensus.cc:348] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.409643 1219 raft_consensus.cc:374] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.409718 1219 raft_consensus.cc:729] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.409799 1202 tablet_bootstrap.cc:492] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.409859 1202 ts_tablet_manager.cc:1367] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:00:58.409852 1205 raft_consensus.cc:482] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.409958 1205 raft_consensus.cc:504] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.410249 1202 raft_consensus.cc:348] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.410332 1202 raft_consensus.cc:374] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.410363 1202 raft_consensus.cc:729] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.410392 1205 leader_election.cc:288] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.410463 1202 consensus_queue.cc:260] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.409855 1219 consensus_queue.cc:260] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.410722 1202 ts_tablet_manager.cc:1398] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:00:58.410725 1219 ts_tablet_manager.cc:1398] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.410878 1202 tablet_bootstrap.cc:492] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: Bootstrap starting.
I20240503 08:00:58.410938 1219 tablet_bootstrap.cc:492] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.411774 1202 tablet_bootstrap.cc:654] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.411819 1219 tablet_bootstrap.cc:654] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.414629 1202 tablet_bootstrap.cc:492] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: No bootstrap required, opened a new log
I20240503 08:00:58.414657 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.414767 1219 tablet_bootstrap.cc:492] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.414810 1008 raft_consensus.cc:2454] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.414790 1202 ts_tablet_manager.cc:1367] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:00:58.414773 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403" is_pre_election: true
I20240503 08:00:58.415017 1159 raft_consensus.cc:2454] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.415092 1047 leader_election.cc:302] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:58.414902 1219 ts_tablet_manager.cc:1367] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240503 08:00:58.415259 1202 raft_consensus.cc:348] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.415346 1205 raft_consensus.cc:2781] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.415365 1202 raft_consensus.cc:374] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.415386 1205 raft_consensus.cc:482] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.415421 1202 raft_consensus.cc:729] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.415457 1205 raft_consensus.cc:3037] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.415552 1202 consensus_queue.cc:260] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.415781 1219 raft_consensus.cc:348] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.415891 1202 ts_tablet_manager.cc:1398] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.415930 1219 raft_consensus.cc:374] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.415964 1219 raft_consensus.cc:729] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.416090 1219 consensus_queue.cc:260] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.416316 1219 ts_tablet_manager.cc:1398] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.416477 1219 tablet_bootstrap.cc:492] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.416471 1205 raft_consensus.cc:504] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.416800 1205 leader_election.cc:288] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.417297 1219 tablet_bootstrap.cc:654] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.417454 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.417517 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.418144 1008 raft_consensus.cc:3037] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.418144 1159 raft_consensus.cc:3037] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.419034 1008 raft_consensus.cc:2454] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.419034 1159 raft_consensus.cc:2454] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.419270 1047 leader_election.cc:302] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:58.419498 1205 raft_consensus.cc:2781] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.419580 1205 raft_consensus.cc:686] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.419698 1205 consensus_queue.cc:237] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.420244 1219 tablet_bootstrap.cc:492] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.420322 1219 ts_tablet_manager.cc:1367] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:00:58.420658 1219 raft_consensus.cc:348] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.420792 1219 raft_consensus.cc:374] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.420847 1219 raft_consensus.cc:729] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.420974 1219 consensus_queue.cc:260] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.421212 1219 ts_tablet_manager.cc:1398] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:00:58.421144 903 catalog_manager.cc:5484] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 1 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.421453 1219 tablet_bootstrap.cc:492] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.422403 1219 tablet_bootstrap.cc:654] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.423329 1219 tablet_bootstrap.cc:492] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.423404 1219 ts_tablet_manager.cc:1367] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:00:58.423785 1219 raft_consensus.cc:348] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.423875 1219 raft_consensus.cc:374] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.423894 1219 raft_consensus.cc:729] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.424000 1219 consensus_queue.cc:260] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.424207 1219 ts_tablet_manager.cc:1398] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.424320 1219 tablet_bootstrap.cc:492] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.425010 1219 tablet_bootstrap.cc:654] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.425897 1219 tablet_bootstrap.cc:492] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.425969 1219 ts_tablet_manager.cc:1367] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:00:58.426333 1219 raft_consensus.cc:348] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.426409 1219 raft_consensus.cc:374] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.426440 1219 raft_consensus.cc:729] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.426543 1219 consensus_queue.cc:260] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.426775 1219 ts_tablet_manager.cc:1398] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.426940 1219 tablet_bootstrap.cc:492] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.427744 1219 tablet_bootstrap.cc:654] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.428644 1219 tablet_bootstrap.cc:492] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.428709 1219 ts_tablet_manager.cc:1367] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:00:58.429054 1219 raft_consensus.cc:348] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.429131 1219 raft_consensus.cc:374] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.429150 1219 raft_consensus.cc:729] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.429236 1219 consensus_queue.cc:260] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.429445 1219 ts_tablet_manager.cc:1398] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.429596 1219 tablet_bootstrap.cc:492] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: Bootstrap starting.
I20240503 08:00:58.430332 1219 tablet_bootstrap.cc:654] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: Neither blocks nor log segments found. Creating new log.
I20240503 08:00:58.431499 1219 tablet_bootstrap.cc:492] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: No bootstrap required, opened a new log
I20240503 08:00:58.431550 1233 raft_consensus.cc:482] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.431583 1219 ts_tablet_manager.cc:1367] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:00:58.431659 1233 raft_consensus.cc:504] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.431985 1233 leader_election.cc:288] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.432000 1219 raft_consensus.cc:348] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.432134 1219 raft_consensus.cc:374] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:00:58.432186 1219 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Initialized, Role: FOLLOWER
I20240503 08:00:58.432241 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.432291 1219 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.432272 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403" is_pre_election: true
I20240503 08:00:58.432359 1008 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.432418 1159 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.432536 1219 ts_tablet_manager.cc:1398] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:00:58.432641 1047 leader_election.cc:302] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.432792 1233 raft_consensus.cc:2781] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.432868 1233 raft_consensus.cc:482] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.432941 1233 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.434180 1233 raft_consensus.cc:504] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.434504 1233 leader_election.cc:288] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.434734 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.434785 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.434844 1008 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.434856 1159 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.435712 1159 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.435712 1008 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.435986 1047 leader_election.cc:302] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.436111 1233 raft_consensus.cc:2781] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.436187 1233 raft_consensus.cc:686] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.436432 1233 consensus_queue.cc:237] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.437649 903 catalog_manager.cc:5484] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 1 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.439009 1233 raft_consensus.cc:482] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.439087 1233 raft_consensus.cc:504] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.439366 1233 leader_election.cc:288] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.439396 1205 raft_consensus.cc:482] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.439512 1205 raft_consensus.cc:504] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.439671 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403" is_pre_election: true
I20240503 08:00:58.439771 1205 leader_election.cc:288] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.439940 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.440022 1008 raft_consensus.cc:2454] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.439775 1159 raft_consensus.cc:2454] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.440066 1007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.440148 1158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403" is_pre_election: true
I20240503 08:00:58.440192 1007 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.440243 1158 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.440251 1047 leader_election.cc:302] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:58.440402 1205 raft_consensus.cc:2781] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.440454 1205 raft_consensus.cc:482] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.440538 1205 raft_consensus.cc:3037] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.440547 1047 leader_election.cc:302] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.440889 1233 raft_consensus.cc:2781] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.440945 1233 raft_consensus.cc:482] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.440979 1233 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.441377 1205 raft_consensus.cc:504] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.441712 1205 leader_election.cc:288] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.441723 1233 raft_consensus.cc:504] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.442044 1233 leader_election.cc:288] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.442032 1007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.442180 1007 raft_consensus.cc:3037] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.442185 1158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.442306 1158 raft_consensus.cc:3037] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.442374 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.442446 1008 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.442859 1007 raft_consensus.cc:2454] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.443167 1008 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.443167 1158 raft_consensus.cc:2454] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.443251 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.443336 1159 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.443465 1047 leader_election.cc:302] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.443603 1233 raft_consensus.cc:2781] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.443682 1047 leader_election.cc:302] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:58.443737 1233 raft_consensus.cc:686] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.443876 1233 consensus_queue.cc:237] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.443964 1205 raft_consensus.cc:2781] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.444123 1159 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.444157 1205 raft_consensus.cc:686] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.444273 1205 consensus_queue.cc:237] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.445282 903 catalog_manager.cc:5484] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 1 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.447773 1204 raft_consensus.cc:482] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.447860 1204 raft_consensus.cc:504] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.448088 903 catalog_manager.cc:5484] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 1 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.448302 1204 leader_election.cc:288] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.451577 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.451701 1008 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.451956 1122 leader_election.cc:302] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.452124 1204 raft_consensus.cc:2781] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.452193 1204 raft_consensus.cc:482] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.452243 1204 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.452302 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" is_pre_election: true
I20240503 08:00:58.452409 1084 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.453053 1204 raft_consensus.cc:504] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.453320 1204 leader_election.cc:288] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.453613 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.453627 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.453771 1008 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.453771 1084 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.454583 1084 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.454583 1008 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.454869 1122 leader_election.cc:302] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.455010 1204 raft_consensus.cc:2781] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.455186 1204 raft_consensus.cc:686] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:58.455309 1204 consensus_queue.cc:237] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.456874 903 catalog_manager.cc:5484] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:58.469430 1225 raft_consensus.cc:482] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.469552 1225 raft_consensus.cc:504] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.470011 1225 leader_election.cc:288] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.472970 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" is_pre_election: true
I20240503 08:00:58.473098 1084 raft_consensus.cc:2454] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 0.
I20240503 08:00:58.473179 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403" is_pre_election: true
I20240503 08:00:58.473291 1159 raft_consensus.cc:2454] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 0.
I20240503 08:00:58.473328 971 leader_election.cc:302] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:58.473461 1225 raft_consensus.cc:2781] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.473516 1225 raft_consensus.cc:482] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.473558 1225 raft_consensus.cc:3037] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.474334 1225 raft_consensus.cc:504] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.474612 1225 leader_election.cc:288] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 1 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.474858 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.474905 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.474969 1084 raft_consensus.cc:3037] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.475000 1159 raft_consensus.cc:3037] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.475659 1084 raft_consensus.cc:2454] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 1.
I20240503 08:00:58.475663 1159 raft_consensus.cc:2454] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 1.
I20240503 08:00:58.475893 971 leader_election.cc:302] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.476033 1225 raft_consensus.cc:2781] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.476116 1225 raft_consensus.cc:686] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:58.476250 1225 consensus_queue.cc:237] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.477711 903 catalog_manager.cc:5484] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.521489 1204 raft_consensus.cc:482] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.521616 1204 raft_consensus.cc:504] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.522006 1204 leader_election.cc:288] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.522380 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.522377 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" is_pre_election: true
I20240503 08:00:58.522534 1008 raft_consensus.cc:2454] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.522549 1084 raft_consensus.cc:2454] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.522789 1122 leader_election.cc:302] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.522981 1204 raft_consensus.cc:2781] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.523044 1204 raft_consensus.cc:482] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.523077 1204 raft_consensus.cc:3037] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.524066 1204 raft_consensus.cc:504] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.524372 1204 leader_election.cc:288] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.524677 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.524677 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.524832 1084 raft_consensus.cc:3037] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.524832 1008 raft_consensus.cc:3037] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.525673 1008 raft_consensus.cc:2454] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.525673 1084 raft_consensus.cc:2454] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.525956 1122 leader_election.cc:302] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.526103 1204 raft_consensus.cc:2781] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.526187 1204 raft_consensus.cc:686] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:58.526327 1204 consensus_queue.cc:237] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.527905 903 catalog_manager.cc:5484] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:58.578933 1204 raft_consensus.cc:482] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.579083 1204 raft_consensus.cc:504] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.579512 1204 leader_election.cc:288] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.579936 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.579927 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" is_pre_election: true
I20240503 08:00:58.580083 1008 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.580083 1084 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.580346 1122 leader_election.cc:302] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.580489 1204 raft_consensus.cc:2781] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.580554 1204 raft_consensus.cc:482] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.580600 1204 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.581369 1204 raft_consensus.cc:504] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.581640 1204 leader_election.cc:288] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.581941 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.581945 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.582056 1084 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.582063 1008 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.582851 1008 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.582851 1084 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.583135 1122 leader_election.cc:302] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.583274 1204 raft_consensus.cc:2781] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.583362 1204 raft_consensus.cc:686] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:58.583535 1204 consensus_queue.cc:237] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.585104 903 catalog_manager.cc:5484] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:58.656877 1233 raft_consensus.cc:482] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.657027 1233 raft_consensus.cc:504] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.657416 1233 leader_election.cc:288] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991), 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139)
I20240503 08:00:58.657761 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403" is_pre_election: true
I20240503 08:00:58.657788 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.657897 1159 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.657917 1008 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 0.
I20240503 08:00:58.658120 1047 leader_election.cc:302] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.658269 1233 raft_consensus.cc:2781] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.658344 1233 raft_consensus.cc:482] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.658387 1233 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.659184 1233 raft_consensus.cc:504] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.659514 1233 leader_election.cc:288] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Requested vote from peers f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991), 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139)
I20240503 08:00:58.659811 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.659829 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.659896 1159 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.659919 1008 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.660566 1159 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.660593 1008 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 1.
I20240503 08:00:58.660799 1047 leader_election.cc:302] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.660936 1233 raft_consensus.cc:2781] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.661020 1233 raft_consensus.cc:686] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.661154 1233 consensus_queue.cc:237] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:58.662592 903 catalog_manager.cc:5484] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 1 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:58.753134 1204 raft_consensus.cc:482] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:00:58.753281 1204 raft_consensus.cc:504] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.753690 1204 leader_election.cc:288] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.754140 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640" is_pre_election: true
I20240503 08:00:58.754140 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" is_pre_election: true
I20240503 08:00:58.754305 1084 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.754305 1008 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 0.
I20240503 08:00:58.754582 1122 leader_election.cc:302] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.754731 1204 raft_consensus.cc:2781] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:00:58.754789 1204 raft_consensus.cc:482] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:00:58.754834 1204 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.755641 1204 raft_consensus.cc:504] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.755928 1204 leader_election.cc:288] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.756251 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.756273 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.756367 1008 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.756420 1084 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:00:58.757011 1008 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.757136 1084 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 1.
I20240503 08:00:58.757244 1122 leader_election.cc:302] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.757383 1204 raft_consensus.cc:2781] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:00:58.757477 1204 raft_consensus.cc:686] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:58.757618 1204 consensus_queue.cc:237] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.759037 903 catalog_manager.cc:5484] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:58.820895 1084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:00:58.821041 1084 raft_consensus.cc:595] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:58.822402 1084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:00:58.822507 1084 raft_consensus.cc:595] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:58.823841 1084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:00:58.823935 1084 raft_consensus.cc:595] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:58.825258 1084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:00:58.825345 1084 raft_consensus.cc:595] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:58.826620 1084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:00:58.826707 1084 raft_consensus.cc:595] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:58.830435 1159 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
mode: GRACEFUL
new_leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:40328
I20240503 08:00:58.830550 1159 raft_consensus.cc:595] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Received request to transfer leadership to TS 94538c84de4e4071a7eb04e9b29dc5ac
I20240503 08:00:58.831954 1159 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
mode: GRACEFUL
new_leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:40328
I20240503 08:00:58.832046 1159 raft_consensus.cc:595] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Received request to transfer leadership to TS 94538c84de4e4071a7eb04e9b29dc5ac
I20240503 08:00:58.833225 1159 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1263559849a402db75cab636b9e7612"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
mode: GRACEFUL
new_leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:40328
I20240503 08:00:58.833312 1159 raft_consensus.cc:595] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Received request to transfer leadership to TS 94538c84de4e4071a7eb04e9b29dc5ac
I20240503 08:00:58.834659 1159 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
mode: GRACEFUL
new_leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:40328
I20240503 08:00:58.834769 1159 raft_consensus.cc:595] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Received request to transfer leadership to TS 94538c84de4e4071a7eb04e9b29dc5ac
I20240503 08:00:58.838493 1008 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
mode: GRACEFUL
new_leader_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:47416
I20240503 08:00:58.838585 1008 raft_consensus.cc:595] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 LEADER]: Received request to transfer leadership to TS f9dd1504bffd41e8af78249a523a9403
I20240503 08:00:58.890189 1233 consensus_queue.cc:1035] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.893174 1241 consensus_queue.cc:1035] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.894999 1233 raft_consensus.cc:979] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:58.895085 1233 raft_consensus.cc:1067] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:58.895491 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:00:58.895603 1008 raft_consensus.cc:482] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:58.895661 1008 raft_consensus.cc:3037] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.896474 1008 raft_consensus.cc:504] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.896797 1008 leader_election.cc:288] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.897020 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.897121 1084 raft_consensus.cc:3032] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:58.897167 1084 raft_consensus.cc:729] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.897289 1084 consensus_queue.cc:260] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.897423 1084 raft_consensus.cc:3037] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.898066 1084 raft_consensus.cc:2454] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:58.898243 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e0fa41a45d446ebb6a34130aa184a8" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.898303 971 leader_election.cc:302] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:58.898339 1159 raft_consensus.cc:3037] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.898443 1225 raft_consensus.cc:2781] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:58.898523 1225 raft_consensus.cc:686] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:58.898634 1225 consensus_queue.cc:237] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.899046 1159 raft_consensus.cc:2454] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:58.899845 904 catalog_manager.cc:5484] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 1 to 2, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.907858 1233 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.909361 1241 raft_consensus.cc:979] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:58.909452 1205 raft_consensus.cc:1067] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:58.909942 1007 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:00:58.910051 1007 raft_consensus.cc:482] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:58.910104 1007 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.910452 1233 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.910933 1007 raft_consensus.cc:504] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.911290 1007 leader_election.cc:288] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.911828 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.911938 1159 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.912147 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.912235 1084 raft_consensus.cc:3032] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:58.912274 1084 raft_consensus.cc:729] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.912385 1084 consensus_queue.cc:260] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.912489 1084 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.912700 1159 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:58.912947 971 leader_election.cc:302] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.913098 1222 raft_consensus.cc:2781] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:58.913131 1084 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:58.913165 1222 raft_consensus.cc:686] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:58.913262 1222 consensus_queue.cc:237] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.914075 1008 raft_consensus.cc:1226] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Rejecting Update request from peer 94538c84de4e4071a7eb04e9b29dc5ac for earlier term 1. Current term is 2. Ops: []
I20240503 08:00:58.914845 903 catalog_manager.cc:5484] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 1 to 2, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.920801 1222 consensus_queue.cc:1035] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.923223 1225 consensus_queue.cc:1035] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.924656 1222 raft_consensus.cc:979] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: : Instructing follower f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:00:58.924743 1222 raft_consensus.cc:1067] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 LEADER]: Signalling peer f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:00:58.925071 1159 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:40316
I20240503 08:00:58.925170 1159 raft_consensus.cc:482] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:58.925230 1159 raft_consensus.cc:3037] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.925911 1159 raft_consensus.cc:504] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.926189 1159 leader_election.cc:288] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 2 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:58.926409 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.926453 1084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37841eca10a74ac6b20bbca1751419fe" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.926503 1008 raft_consensus.cc:3032] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:58.926539 1008 raft_consensus.cc:729] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:58.926542 1084 raft_consensus.cc:3037] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.926661 1008 consensus_queue.cc:260] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.926805 1008 raft_consensus.cc:3037] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.927284 1084 raft_consensus.cc:2454] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 2.
I20240503 08:00:58.927481 1008 raft_consensus.cc:2454] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 2.
I20240503 08:00:58.927541 1122 leader_election.cc:302] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.927685 1245 raft_consensus.cc:2781] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:58.927773 1245 raft_consensus.cc:686] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 2 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:58.927896 1245 consensus_queue.cc:237] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.929090 904 catalog_manager.cc:5484] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 1 to 2, leader changed from 632b23a6349a4d009ea42004b6b51640 (127.0.99.1) to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 2 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:00:58.941437 1245 consensus_queue.cc:1035] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.943017 1204 raft_consensus.cc:979] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: : Instructing follower 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:58.943141 1204 raft_consensus.cc:1067] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Signalling peer 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:58.943557 1083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:55476
I20240503 08:00:58.943660 1083 raft_consensus.cc:482] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:58.943709 1083 raft_consensus.cc:3037] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.944612 1083 raft_consensus.cc:504] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.944896 1204 consensus_queue.cc:1035] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.944970 1083 leader_election.cc:288] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.945394 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:58.946012 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "963e451b93b44b04a305e4b5f5cd067e" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.946152 1159 raft_consensus.cc:3032] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:58.946205 1159 raft_consensus.cc:729] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:58.946796 1159 consensus_queue.cc:260] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.946959 1159 raft_consensus.cc:3037] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.947618 1159 raft_consensus.cc:2454] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 2.
I20240503 08:00:58.947829 1047 leader_election.cc:302] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters: 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:58.947968 1233 raft_consensus.cc:2781] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:58.948058 1233 raft_consensus.cc:686] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.948175 1233 consensus_queue.cc:237] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.949242 904 catalog_manager.cc:5484] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 1 to 2, leader changed from f9dd1504bffd41e8af78249a523a9403 (127.0.99.3) to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 2 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.983862 1233 consensus_queue.cc:1035] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.985481 1241 raft_consensus.cc:979] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:58.985599 1205 raft_consensus.cc:1067] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:58.986002 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:00:58.986121 1008 raft_consensus.cc:482] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:58.986176 1008 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.986706 1233 consensus_queue.cc:1035] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.987126 1008 raft_consensus.cc:504] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.987316 1007 raft_consensus.cc:1226] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Rejecting Update request from peer 94538c84de4e4071a7eb04e9b29dc5ac for earlier term 1. Current term is 2. Ops: []
I20240503 08:00:58.987504 1008 leader_election.cc:288] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:58.987985 1233 consensus_queue.cc:1046] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:58.988134 1233 raft_consensus.cc:3032] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:58.988170 1158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:58.988272 1158 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.989111 1158 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:58.989274 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:58.989377 971 leader_election.cc:302] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:58.988176 1233 raft_consensus.cc:729] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:58.989521 1225 raft_consensus.cc:2781] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:58.989548 1233 consensus_queue.cc:260] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.989621 1225 raft_consensus.cc:686] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:58.989712 1233 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:58.989742 1225 consensus_queue.cc:237] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:58.990949 904 catalog_manager.cc:5484] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 1 to 2, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:58.991158 1083 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:59.005806 1233 consensus_queue.cc:1035] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.007491 1241 raft_consensus.cc:979] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:59.007586 1205 raft_consensus.cc:1067] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:59.008220 1007 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:00:59.008411 1007 raft_consensus.cc:482] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:59.008474 1007 raft_consensus.cc:3037] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.008951 1205 consensus_queue.cc:1035] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.009435 1007 raft_consensus.cc:504] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.009760 1007 leader_election.cc:288] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:59.010190 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:59.010562 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368bae6cc184be1baf0222034c2b644" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:59.010658 1083 raft_consensus.cc:3032] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:59.010696 1083 raft_consensus.cc:729] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:59.010818 1083 consensus_queue.cc:260] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.010957 1083 raft_consensus.cc:3037] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.011761 1083 raft_consensus.cc:2454] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:59.011999 971 leader_election.cc:302] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters: f9dd1504bffd41e8af78249a523a9403
I20240503 08:00:59.012159 1222 raft_consensus.cc:2781] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:59.012240 1222 raft_consensus.cc:686] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:59.012362 1222 consensus_queue.cc:237] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.013535 903 catalog_manager.cc:5484] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 1 to 2, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:59.019570 1245 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.021106 1204 raft_consensus.cc:979] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: : Instructing follower 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:59.021185 1204 raft_consensus.cc:1067] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Signalling peer 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:59.021549 1084 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:55476
I20240503 08:00:59.021664 1084 raft_consensus.cc:482] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:59.021725 1084 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.022432 1245 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.022670 1084 raft_consensus.cc:504] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.023011 1084 leader_election.cc:288] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:59.023253 1158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:59.023306 1083 raft_consensus.cc:1226] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Rejecting Update request from peer f9dd1504bffd41e8af78249a523a9403 for earlier term 1. Current term is 2. Ops: []
I20240503 08:00:59.023357 1158 raft_consensus.cc:3032] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:59.023396 1158 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:59.023537 1158 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.023602 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:59.023638 1158 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.024710 1158 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 2.
I20240503 08:00:59.024911 1047 leader_election.cc:302] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters: 632b23a6349a4d009ea42004b6b51640
I20240503 08:00:59.025058 1205 raft_consensus.cc:2781] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:59.025142 1205 raft_consensus.cc:686] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:59.025259 1205 consensus_queue.cc:237] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.026336 903 catalog_manager.cc:5484] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 1 to 2, leader changed from f9dd1504bffd41e8af78249a523a9403 (127.0.99.3) to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 2 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:59.043987 1205 consensus_queue.cc:1035] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.045606 1233 raft_consensus.cc:979] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:59.045789 1205 raft_consensus.cc:1067] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:00:59.046123 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:00:59.046249 1008 raft_consensus.cc:482] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:59.046303 1008 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.047068 1008 raft_consensus.cc:504] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:59.047387 1008 leader_election.cc:288] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Requested vote from peers f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:00:59.047883 1158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:59.047997 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:00:59.048137 1083 raft_consensus.cc:3032] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:59.048182 1083 raft_consensus.cc:729] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:59.047996 1158 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.048311 1083 consensus_queue.cc:260] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:59.048482 1083 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.049067 1158 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:59.049183 1083 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 2.
I20240503 08:00:59.049222 1159 raft_consensus.cc:1226] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Rejecting Update request from peer 94538c84de4e4071a7eb04e9b29dc5ac for earlier term 1. Current term is 2. Ops: []
I20240503 08:00:59.049384 971 leader_election.cc:302] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:00:59.049609 1225 raft_consensus.cc:2781] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:59.049687 1225 raft_consensus.cc:686] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:00:59.049816 1225 consensus_queue.cc:237] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:00:59.050961 903 catalog_manager.cc:5484] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 1 to 2, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 2 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:59.127149 1245 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.130223 1245 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.131800 1204 raft_consensus.cc:979] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: : Instructing follower 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:59.131896 1204 raft_consensus.cc:1067] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Signalling peer 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:59.132241 1083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e1263559849a402db75cab636b9e7612"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:55476
I20240503 08:00:59.132346 1083 raft_consensus.cc:482] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:59.132405 1083 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.133374 1083 raft_consensus.cc:504] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.133671 1083 leader_election.cc:288] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:59.133955 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:59.134047 1008 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.134047 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:59.134191 1159 raft_consensus.cc:3032] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:59.134235 1159 raft_consensus.cc:729] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:59.134361 1159 consensus_queue.cc:260] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.134502 1159 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.134778 1008 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 2.
I20240503 08:00:59.135023 1047 leader_election.cc:302] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:59.135171 1233 raft_consensus.cc:2781] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:59.135191 1159 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 2.
I20240503 08:00:59.135246 1233 raft_consensus.cc:686] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:59.135382 1233 consensus_queue.cc:237] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.136557 903 catalog_manager.cc:5484] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 1 to 2, leader changed from f9dd1504bffd41e8af78249a523a9403 (127.0.99.3) to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 2 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:59.289913 1204 consensus_queue.cc:1035] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.292820 1204 consensus_queue.cc:1035] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.294512 1264 raft_consensus.cc:979] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: : Instructing follower 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:59.294611 1264 raft_consensus.cc:1067] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Signalling peer 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:00:59.294988 1083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:55476
I20240503 08:00:59.295094 1083 raft_consensus.cc:482] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:00:59.295142 1083 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.295945 1083 raft_consensus.cc:504] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.296270 1083 leader_election.cc:288] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:00:59.296520 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:00:59.296628 1008 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.296679 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:00:59.296801 1159 raft_consensus.cc:3032] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:00:59.296844 1159 raft_consensus.cc:729] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:00:59.296977 1159 consensus_queue.cc:260] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.297137 1159 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.297588 1008 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 2.
I20240503 08:00:59.297863 1047 leader_election.cc:302] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:00:59.297988 1159 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 2.
I20240503 08:00:59.298051 1233 raft_consensus.cc:2781] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:00:59.298149 1233 raft_consensus.cc:686] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:00:59.298270 1233 consensus_queue.cc:237] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:00:59.299410 904 catalog_manager.cc:5484] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 1 to 2, leader changed from f9dd1504bffd41e8af78249a523a9403 (127.0.99.3) to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 2 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:00:59.329921 1008 raft_consensus.cc:1261] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.330302 1264 consensus_queue.cc:1035] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.332386 1083 raft_consensus.cc:1261] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.332743 1245 consensus_queue.cc:1035] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.381433 1083 raft_consensus.cc:1261] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.381878 1225 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.384030 1159 raft_consensus.cc:1261] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.384455 1225 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.429589 1159 raft_consensus.cc:1261] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.429976 1233 consensus_queue.cc:1035] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.431900 1159 raft_consensus.cc:1261] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.432287 1225 consensus_queue.cc:1035] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.432879 1008 raft_consensus.cc:3037] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.434505 1083 raft_consensus.cc:1261] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.434757 1008 raft_consensus.cc:1261] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.434952 1277 consensus_queue.cc:1035] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.435195 1233 consensus_queue.cc:1035] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.455861 1158 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.456327 1233 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.456604 1158 raft_consensus.cc:1261] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.456971 1277 consensus_queue.cc:1035] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.459214 1008 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.460481 1083 raft_consensus.cc:1261] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.460778 1225 consensus_queue.cc:1035] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.460817 1008 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.461321 1233 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.525005 1083 raft_consensus.cc:1261] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.525446 1278 consensus_queue.cc:1035] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.527582 1158 raft_consensus.cc:3037] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:00:59.528591 1158 raft_consensus.cc:1261] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.528940 1225 consensus_queue.cc:1035] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.567062 1083 raft_consensus.cc:1261] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.567502 1225 consensus_queue.cc:1035] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.570070 1158 raft_consensus.cc:1261] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.571179 1225 consensus_queue.cc:1035] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:00:59.604682 1008 raft_consensus.cc:1261] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.605219 1233 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.607293 1158 raft_consensus.cc:1261] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.607725 1233 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.825336 1008 raft_consensus.cc:1261] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.825757 1233 consensus_queue.cc:1035] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:00:59.828511 1158 raft_consensus.cc:1261] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:00:59.828886 1241 consensus_queue.cc:1035] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:01.845160 396 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240503 08:01:01.845306 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:01.849499 1008 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
mode: GRACEFUL
new_leader_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:47430
I20240503 08:01:01.849630 1008 raft_consensus.cc:595] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Received request to transfer leadership to TS f9dd1504bffd41e8af78249a523a9403
I20240503 08:01:01.852815 1083 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:55496
I20240503 08:01:01.852943 1083 raft_consensus.cc:595] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Received request to transfer leadership to TS f9dd1504bffd41e8af78249a523a9403
I20240503 08:01:01.853219 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240503 08:01:01.853318 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:01.916639 1280 raft_consensus.cc:979] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: : Instructing follower f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:01.916802 1280 raft_consensus.cc:1067] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Signalling peer f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:01.917187 1158 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:40316
I20240503 08:01:01.917335 1158 raft_consensus.cc:482] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:01.917387 1158 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:01.918175 1158 raft_consensus.cc:504] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:01.918493 1158 leader_election.cc:288] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:01:01.918793 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:01:01.918833 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:01.918893 1008 raft_consensus.cc:3032] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:01:01.918941 1083 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:01.918946 1008 raft_consensus.cc:729] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:01.919122 1008 consensus_queue.cc:260] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:01.919292 1008 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:01.919786 1083 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:01.920038 1008 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:01.920050 1122 leader_election.cc:302] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:01.920185 1264 raft_consensus.cc:2781] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:01:01.920511 1264 raft_consensus.cc:686] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:01:01.920662 1264 consensus_queue.cc:237] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:01.922106 902 catalog_manager.cc:5484] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 2 to 3, leader changed from 632b23a6349a4d009ea42004b6b51640 (127.0.99.1) to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 3 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:02.392062 1241 raft_consensus.cc:979] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:02.392199 1241 raft_consensus.cc:1067] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Signalling peer f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:02.392602 1158 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:40300
I20240503 08:01:02.392743 1158 raft_consensus.cc:482] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:02.392810 1158 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:02.393934 1158 raft_consensus.cc:504] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:02.394328 1158 leader_election.cc:288] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:01:02.394606 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:01:02.394681 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:02.394714 1008 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:02.394796 1083 raft_consensus.cc:3032] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:01:02.394842 1083 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:01:02.394992 1083 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:02.395140 1083 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:02.395570 1008 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:02.395814 1122 leader_election.cc:302] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:02.395902 1083 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:02.395972 1264 raft_consensus.cc:2781] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:01:02.396044 1264 raft_consensus.cc:686] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:01:02.396164 1264 consensus_queue.cc:237] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:02.397585 902 catalog_manager.cc:5484] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 2 to 3, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 3 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:02.415041 1008 raft_consensus.cc:1261] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:02.415572 1264 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:02.418396 1083 raft_consensus.cc:1261] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:02.418766 1294 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:02.799319 1083 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:02.799791 1294 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:02.802291 1008 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:02.802644 1294 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:02.853638 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:02.854555 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:02.854625 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:03.854882 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:03.855867 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:03.855950 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:04.858824 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:04.859779 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:04.859853 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:05.860162 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:05.861079 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:05.861152 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:06.861461 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:06.862406 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:06.862480 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:07.862756 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:07.863665 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:07.863734 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:08.864056 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:08.864996 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:08.865072 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:09.865350 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:09.866269 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:09.866340 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:10.866612 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:10.867599 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:10.867677 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:11.876351 396 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240503 08:01:11.879112 1159 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:40328
I20240503 08:01:11.879261 1159 raft_consensus.cc:595] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:01:11.882107 1083 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:01:11.882246 1083 raft_consensus.cc:595] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:01:11.883615 1159 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:40328
I20240503 08:01:11.883733 1159 raft_consensus.cc:595] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:01:11.884958 1083 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1263559849a402db75cab636b9e7612"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
mode: GRACEFUL
new_leader_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:55494
I20240503 08:01:11.885076 1083 raft_consensus.cc:595] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Received request to transfer leadership to TS 632b23a6349a4d009ea42004b6b51640
I20240503 08:01:11.947875 1264 raft_consensus.cc:979] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:11.947997 1264 raft_consensus.cc:1067] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:11.948599 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47402
I20240503 08:01:11.948752 1008 raft_consensus.cc:482] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:11.948824 1008 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:11.949635 1008 raft_consensus.cc:504] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:11.949959 1008 leader_election.cc:288] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 4 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:01:11.950261 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:11.950309 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "127c7f6ea3d342c8aa2d9bb4fc77ba0e" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:01:11.950361 1083 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:11.950443 1159 raft_consensus.cc:3032] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:01:11.950500 1159 raft_consensus.cc:729] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:01:11.950630 1159 consensus_queue.cc:260] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:11.950770 1159 raft_consensus.cc:3037] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:11.951177 1083 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 4.
I20240503 08:01:11.951542 971 leader_election.cc:302] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:01:11.951588 1159 raft_consensus.cc:2454] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 4.
I20240503 08:01:11.951776 1303 raft_consensus.cc:2781] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:01:11.951942 1303 raft_consensus.cc:686] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:11.952090 1303 consensus_queue.cc:237] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:11.953691 904 catalog_manager.cc:5484] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 3 to 4, leader changed from f9dd1504bffd41e8af78249a523a9403 (127.0.99.3) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 4 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:12.031695 1241 raft_consensus.cc:979] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:12.031816 1241 raft_consensus.cc:1067] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:12.032259 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:01:12.032394 1008 raft_consensus.cc:482] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:12.032438 1008 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:12.033196 1008 raft_consensus.cc:504] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.033520 1008 leader_election.cc:288] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 3 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:01:12.033870 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:12.033870 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18bdba1aeb848009b9c242b845d3eb9" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:01:12.034008 1159 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:12.034008 1083 raft_consensus.cc:3032] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:01:12.034083 1083 raft_consensus.cc:729] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:01:12.034224 1083 consensus_queue.cc:260] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.034391 1083 raft_consensus.cc:3037] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:12.034952 1159 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 3.
I20240503 08:01:12.035230 971 leader_election.cc:302] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:12.035274 1083 raft_consensus.cc:2454] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 3.
I20240503 08:01:12.035452 1303 raft_consensus.cc:2781] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:01:12.035562 1303 raft_consensus.cc:686] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:12.035715 1303 consensus_queue.cc:237] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.037192 904 catalog_manager.cc:5484] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 2 to 3, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 3 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:12.075922 1311 raft_consensus.cc:979] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:12.076045 1311 raft_consensus.cc:1067] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:12.076444 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e1263559849a402db75cab636b9e7612"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47390
I20240503 08:01:12.076575 1008 raft_consensus.cc:482] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:12.076623 1008 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:12.077395 1008 raft_consensus.cc:504] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.077699 1008 leader_election.cc:288] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 3 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:01:12.078027 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:12.078048 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:01:12.078166 1083 raft_consensus.cc:3032] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:01:12.078179 1159 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:12.078220 1083 raft_consensus.cc:729] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:01:12.078356 1083 consensus_queue.cc:260] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.078505 1083 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:12.078961 1159 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 3.
I20240503 08:01:12.079205 1083 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 3.
I20240503 08:01:12.079217 971 leader_election.cc:302] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:12.079483 1303 raft_consensus.cc:2781] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:01:12.079574 1303 raft_consensus.cc:686] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:12.079703 1303 consensus_queue.cc:237] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.081084 904 catalog_manager.cc:5484] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 2 to 3, leader changed from 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 3 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:12.092262 1304 raft_consensus.cc:979] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: : Instructing follower 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:12.092344 1304 raft_consensus.cc:1067] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Signalling peer 632b23a6349a4d009ea42004b6b51640 to start an election
I20240503 08:01:12.092680 1008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
from {username='slave'} at 127.0.0.1:47402
I20240503 08:01:12.092778 1008 raft_consensus.cc:482] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:12.092835 1008 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:12.093526 1008 raft_consensus.cc:504] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.093816 1008 leader_election.cc:288] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 4 election: Requested vote from peers 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:01:12.094049 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:12.094086 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "632b23a6349a4d009ea42004b6b51640" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:01:12.094142 1083 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:12.094197 1159 raft_consensus.cc:3032] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:01:12.094242 1159 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:01:12.094367 1159 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.094501 1159 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:12.094890 1083 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 4.
I20240503 08:01:12.095165 971 leader_election.cc:302] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 632b23a6349a4d009ea42004b6b51640, 94538c84de4e4071a7eb04e9b29dc5ac; no voters:
I20240503 08:01:12.095182 1159 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 632b23a6349a4d009ea42004b6b51640 in term 4.
I20240503 08:01:12.095335 1303 raft_consensus.cc:2781] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:01:12.095455 1303 raft_consensus.cc:686] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Becoming Leader. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:12.095578 1303 consensus_queue.cc:237] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:12.096933 904 catalog_manager.cc:5484] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 reported cstate change: term changed from 3 to 4, leader changed from f9dd1504bffd41e8af78249a523a9403 (127.0.99.3) to 632b23a6349a4d009ea42004b6b51640 (127.0.99.1). New cstate: current_term: 4 leader_uuid: "632b23a6349a4d009ea42004b6b51640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:12.361768 1159 raft_consensus.cc:1261] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:01:12.362154 1303 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:12.364403 1083 raft_consensus.cc:1261] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:01:12.364851 1303 consensus_queue.cc:1035] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:12.505082 1083 raft_consensus.cc:1261] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:12.505501 1317 consensus_queue.cc:1035] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:12.508216 1159 raft_consensus.cc:1261] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:12.508620 1317 consensus_queue.cc:1035] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:12.516721 1083 raft_consensus.cc:1261] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:12.517135 1317 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:12.519380 1159 raft_consensus.cc:1261] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:12.519812 1317 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:12.581872 1083 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:01:12.581872 1159 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Refusing update from remote peer 632b23a6349a4d009ea42004b6b51640: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:01:12.582342 1317 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:12.582497 1303 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:14.893779 396 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240503 08:01:14.893940 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:14.895213 1008 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
mode: GRACEFUL
new_leader_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:47430
I20240503 08:01:14.895364 1008 raft_consensus.cc:595] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Received request to transfer leadership to TS f9dd1504bffd41e8af78249a523a9403
I20240503 08:01:14.896045 1008 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
mode: GRACEFUL
new_leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:47430
I20240503 08:01:14.896155 1008 raft_consensus.cc:595] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Received request to transfer leadership to TS 94538c84de4e4071a7eb04e9b29dc5ac
I20240503 08:01:14.896876 1008 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e1263559849a402db75cab636b9e7612"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
mode: GRACEFUL
new_leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:47430
I20240503 08:01:14.896984 1008 raft_consensus.cc:595] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Received request to transfer leadership to TS 94538c84de4e4071a7eb04e9b29dc5ac
I20240503 08:01:14.897545 1008 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8"
dest_uuid: "632b23a6349a4d009ea42004b6b51640"
mode: GRACEFUL
new_leader_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:47430
I20240503 08:01:14.897641 1008 raft_consensus.cc:595] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Received request to transfer leadership to TS f9dd1504bffd41e8af78249a523a9403
I20240503 08:01:14.897876 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240503 08:01:14.897977 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:15.025050 1305 raft_consensus.cc:979] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: : Instructing follower 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:01:15.025159 1305 raft_consensus.cc:1067] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Signalling peer 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:01:15.025547 1083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:55492
I20240503 08:01:15.025717 1083 raft_consensus.cc:482] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:15.025782 1083 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:01:15.026567 1083 raft_consensus.cc:504] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.027001 1083 leader_election.cc:288] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 5 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:01:15.027279 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:01:15.027377 1008 raft_consensus.cc:3032] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Stepping down as leader of term 4
I20240503 08:01:15.027333 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf11d78cba347d59218a6babf55f979" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:01:15.027426 1008 raft_consensus.cc:729] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:15.027494 1159 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:01:15.027603 1008 consensus_queue.cc:260] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.027757 1008 raft_consensus.cc:3037] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:01:15.028277 1159 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 5.
I20240503 08:01:15.028412 1008 raft_consensus.cc:2454] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 5.
I20240503 08:01:15.028563 1047 leader_election.cc:302] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:15.028735 1311 raft_consensus.cc:2781] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 5 FOLLOWER]: Leader election won for term 5
I20240503 08:01:15.028903 1311 raft_consensus.cc:686] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 5 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:01:15.029057 1311 consensus_queue.cc:237] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.030393 905 catalog_manager.cc:5484] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 4 to 5, leader changed from 632b23a6349a4d009ea42004b6b51640 (127.0.99.1) to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 5 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:15.209751 1329 raft_consensus.cc:979] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: : Instructing follower 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:01:15.209900 1329 raft_consensus.cc:1067] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Signalling peer 94538c84de4e4071a7eb04e9b29dc5ac to start an election
I20240503 08:01:15.210258 1083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e1263559849a402db75cab636b9e7612"
dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
from {username='slave'} at 127.0.0.1:55492
I20240503 08:01:15.210373 1083 raft_consensus.cc:482] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:15.210417 1083 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:15.211174 1083 raft_consensus.cc:504] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.211510 1083 leader_election.cc:288] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 4 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), f9dd1504bffd41e8af78249a523a9403 (127.0.99.3:42991)
I20240503 08:01:15.211727 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:01:15.211750 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1263559849a402db75cab636b9e7612" candidate_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
I20240503 08:01:15.211828 1008 raft_consensus.cc:3032] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:01:15.211858 1159 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:15.211874 1008 raft_consensus.cc:729] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:15.212040 1008 consensus_queue.cc:260] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.212167 1008 raft_consensus.cc:3037] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:01:15.212599 1159 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 4.
I20240503 08:01:15.212827 1008 raft_consensus.cc:2454] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94538c84de4e4071a7eb04e9b29dc5ac in term 4.
I20240503 08:01:15.212841 1047 leader_election.cc:302] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:15.212994 1311 raft_consensus.cc:2781] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:01:15.213078 1311 raft_consensus.cc:686] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 LEADER]: Becoming Leader. State: Replica: 94538c84de4e4071a7eb04e9b29dc5ac, State: Running, Role: LEADER
I20240503 08:01:15.213204 1311 consensus_queue.cc:237] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.214609 905 catalog_manager.cc:5484] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac reported cstate change: term changed from 3 to 4, leader changed from 632b23a6349a4d009ea42004b6b51640 (127.0.99.1) to 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2). New cstate: current_term: 4 leader_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:15.217252 1305 raft_consensus.cc:979] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: : Instructing follower f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:15.217324 1305 raft_consensus.cc:1067] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Signalling peer f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:15.217653 1159 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:40316
I20240503 08:01:15.217751 1159 raft_consensus.cc:482] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:15.217797 1159 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:15.218426 1159 raft_consensus.cc:504] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:01:15.218773 1159 leader_election.cc:288] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:01:15.219084 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:15.219184 1083 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:15.219535 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed06dd84f5824f3c92340f5cc43175e8" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:01:15.219617 1008 raft_consensus.cc:3032] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:01:15.219653 1008 raft_consensus.cc:729] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:15.219770 1008 consensus_queue.cc:260] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:01:15.219887 1008 raft_consensus.cc:3037] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:15.220001 1083 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:15.220321 1122 leader_election.cc:302] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:15.220496 1328 raft_consensus.cc:2781] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:01:15.220635 1008 raft_consensus.cc:2454] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:15.220712 1328 raft_consensus.cc:686] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:01:15.220857 1328 consensus_queue.cc:237] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } }
I20240503 08:01:15.222291 905 catalog_manager.cc:5484] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 2 to 3, leader changed from 632b23a6349a4d009ea42004b6b51640 (127.0.99.1) to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 3 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:15.323993 1329 raft_consensus.cc:979] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: : Instructing follower f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:15.324113 1329 raft_consensus.cc:1067] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Signalling peer f9dd1504bffd41e8af78249a523a9403 to start an election
I20240503 08:01:15.324510 1159 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac"
dest_uuid: "f9dd1504bffd41e8af78249a523a9403"
from {username='slave'} at 127.0.0.1:40316
I20240503 08:01:15.324641 1159 raft_consensus.cc:482] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:01:15.324699 1159 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:15.325481 1159 raft_consensus.cc:504] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.325809 1159 leader_election.cc:288] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Requested vote from peers 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139), 94538c84de4e4071a7eb04e9b29dc5ac (127.0.99.2:39739)
I20240503 08:01:15.326097 1008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "632b23a6349a4d009ea42004b6b51640"
I20240503 08:01:15.326203 1008 raft_consensus.cc:3032] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:01:15.326195 1083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cdfaa9f47d54b5fb358f9aeccfc39ac" candidate_uuid: "f9dd1504bffd41e8af78249a523a9403" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94538c84de4e4071a7eb04e9b29dc5ac"
I20240503 08:01:15.326279 1008 raft_consensus.cc:729] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 632b23a6349a4d009ea42004b6b51640, State: Running, Role: LEADER
I20240503 08:01:15.326323 1083 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:15.326419 1008 consensus_queue.cc:260] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.326583 1008 raft_consensus.cc:3037] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:01:15.327133 1083 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:15.327241 1008 raft_consensus.cc:2454] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9dd1504bffd41e8af78249a523a9403 in term 3.
I20240503 08:01:15.327379 1122 leader_election.cc:302] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94538c84de4e4071a7eb04e9b29dc5ac, f9dd1504bffd41e8af78249a523a9403; no voters:
I20240503 08:01:15.327584 1337 raft_consensus.cc:2781] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:01:15.327667 1337 raft_consensus.cc:686] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Becoming Leader. State: Replica: f9dd1504bffd41e8af78249a523a9403, State: Running, Role: LEADER
I20240503 08:01:15.327801 1337 consensus_queue.cc:237] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } }
I20240503 08:01:15.329289 905 catalog_manager.cc:5484] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 reported cstate change: term changed from 2 to 3, leader changed from 632b23a6349a4d009ea42004b6b51640 (127.0.99.1) to f9dd1504bffd41e8af78249a523a9403 (127.0.99.3). New cstate: current_term: 3 leader_uuid: "f9dd1504bffd41e8af78249a523a9403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:15.492419 1008 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 5 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 08:01:15.492805 1311 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 08:01:15.495290 1159 raft_consensus.cc:1261] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 5 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 08:01:15.495736 1342 consensus_queue.cc:1035] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 08:01:15.673336 1008 raft_consensus.cc:1261] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:15.673705 1337 consensus_queue.cc:1035] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:15.675948 1083 raft_consensus.cc:1261] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:15.676364 1337 consensus_queue.cc:1035] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:15.739200 1008 raft_consensus.cc:1261] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:01:15.739606 1342 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:15.741742 1159 raft_consensus.cc:1261] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Refusing update from remote peer 94538c84de4e4071a7eb04e9b29dc5ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:01:15.742163 1342 consensus_queue.cc:1035] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9dd1504bffd41e8af78249a523a9403" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 42991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:15.781062 1083 raft_consensus.cc:1261] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:15.781585 1337 consensus_queue.cc:1035] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94538c84de4e4071a7eb04e9b29dc5ac" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 39739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:15.784080 1008 raft_consensus.cc:1261] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Refusing update from remote peer f9dd1504bffd41e8af78249a523a9403: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:01:15.784482 1337 consensus_queue.cc:1035] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632b23a6349a4d009ea42004b6b51640" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 35139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:15.898267 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:15.899243 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:15.899340 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:16.899569 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:16.900523 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:16.900606 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:17.900892 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:17.901880 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:17.901969 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:18.902282 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:18.903321 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:18.903424 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:19.903703 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:19.904676 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:19.904760 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:20.904986 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:20.905876 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:20.905943 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:21.906198 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:21.907104 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:21.907178 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:22.907456 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:22.908383 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:22.908453 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:23.908732 396 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:01:23.909641 396 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:01:23.909706 396 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:01:24.917690 396 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240503 08:01:24.917840 396 tablet_server.cc:178] TabletServer@127.0.99.1:0 shutting down...
I20240503 08:01:24.921811 396 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:01:24.921976 396 tablet_replica.cc:330] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.922101 396 raft_consensus.cc:2229] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.922271 396 raft_consensus.cc:2258] T e18bdba1aeb848009b9c242b845d3eb9 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.922657 396 tablet_replica.cc:330] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.922741 396 raft_consensus.cc:2229] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.922814 396 raft_consensus.cc:2258] T 4bf11d78cba347d59218a6babf55f979 P 632b23a6349a4d009ea42004b6b51640 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.923069 396 tablet_replica.cc:330] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.923136 396 raft_consensus.cc:2229] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.923203 396 raft_consensus.cc:2258] T e1263559849a402db75cab636b9e7612 P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.923537 396 tablet_replica.cc:330] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.923628 396 raft_consensus.cc:2229] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.923779 396 raft_consensus.cc:2258] T 7368bae6cc184be1baf0222034c2b644 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.924042 396 tablet_replica.cc:330] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.924111 396 raft_consensus.cc:2229] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.924175 396 raft_consensus.cc:2258] T 37841eca10a74ac6b20bbca1751419fe P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.924408 396 tablet_replica.cc:330] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.924485 396 raft_consensus.cc:2229] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.924553 396 raft_consensus.cc:2258] T ed06dd84f5824f3c92340f5cc43175e8 P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.924811 396 tablet_replica.cc:330] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.924873 396 raft_consensus.cc:2229] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.924983 396 raft_consensus.cc:2258] T a8e0fa41a45d446ebb6a34130aa184a8 P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.925226 396 tablet_replica.cc:330] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.925290 396 raft_consensus.cc:2229] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.925396 396 raft_consensus.cc:2258] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 632b23a6349a4d009ea42004b6b51640 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.925637 396 tablet_replica.cc:330] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.925699 396 raft_consensus.cc:2229] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.925763 396 raft_consensus.cc:2258] T 963e451b93b44b04a305e4b5f5cd067e P 632b23a6349a4d009ea42004b6b51640 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.925997 396 tablet_replica.cc:330] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640: stopping tablet replica
I20240503 08:01:24.926055 396 raft_consensus.cc:2229] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.926117 396 raft_consensus.cc:2258] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 632b23a6349a4d009ea42004b6b51640 [term 3 FOLLOWER]: Raft consensus is shut down!
W20240503 08:01:24.931171 1122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.99.1:35139: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20240503 08:01:24.931874 1122 consensus_peers.cc:485] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 -> Peer 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139): Couldn't send request to peer 632b23a6349a4d009ea42004b6b51640. Status: Network error: Client connection negotiation failed: client connection to 127.0.99.1:35139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240503 08:01:24.932826 1122 consensus_peers.cc:485] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 -> Peer 632b23a6349a4d009ea42004b6b51640 (127.0.99.1:35139): Couldn't send request to peer 632b23a6349a4d009ea42004b6b51640. Status: Network error: Client connection negotiation failed: client connection to 127.0.99.1:35139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:24.939519 396 tablet_server.cc:194] TabletServer@127.0.99.1:0 shutdown complete.
I20240503 08:01:24.942178 396 tablet_server.cc:178] TabletServer@127.0.99.2:0 shutting down...
I20240503 08:01:24.946367 396 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:01:24.946522 396 tablet_replica.cc:330] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.946633 396 raft_consensus.cc:2229] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.946733 396 raft_consensus.cc:2258] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.947074 396 tablet_replica.cc:330] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.947150 396 raft_consensus.cc:2229] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.947256 396 raft_consensus.cc:2258] T e18bdba1aeb848009b9c242b845d3eb9 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.947546 396 tablet_replica.cc:330] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.947623 396 raft_consensus.cc:2229] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.947690 396 raft_consensus.cc:2258] T 7368bae6cc184be1baf0222034c2b644 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.947945 396 tablet_replica.cc:330] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.948015 396 raft_consensus.cc:2229] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.948081 396 raft_consensus.cc:2258] T 37841eca10a74ac6b20bbca1751419fe P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.948325 396 tablet_replica.cc:330] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.948393 396 raft_consensus.cc:2229] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.948458 396 raft_consensus.cc:2258] T ed06dd84f5824f3c92340f5cc43175e8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.948686 396 tablet_replica.cc:330] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.948756 396 raft_consensus.cc:2229] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.948822 396 raft_consensus.cc:2258] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P 94538c84de4e4071a7eb04e9b29dc5ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.949046 396 tablet_replica.cc:330] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.949108 396 raft_consensus.cc:2229] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.949239 396 raft_consensus.cc:2258] T 963e451b93b44b04a305e4b5f5cd067e P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.949476 396 tablet_replica.cc:330] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.949537 396 raft_consensus.cc:2229] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.949599 396 raft_consensus.cc:2258] T a8e0fa41a45d446ebb6a34130aa184a8 P 94538c84de4e4071a7eb04e9b29dc5ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.949841 396 tablet_replica.cc:330] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.949901 396 raft_consensus.cc:2229] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 5 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.950016 396 raft_consensus.cc:2258] T 4bf11d78cba347d59218a6babf55f979 P 94538c84de4e4071a7eb04e9b29dc5ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.950254 396 tablet_replica.cc:330] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac: stopping tablet replica
I20240503 08:01:24.950316 396 raft_consensus.cc:2229] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.950428 396 raft_consensus.cc:2258] T e1263559849a402db75cab636b9e7612 P 94538c84de4e4071a7eb04e9b29dc5ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.963851 396 tablet_server.cc:194] TabletServer@127.0.99.2:0 shutdown complete.
I20240503 08:01:24.966571 396 tablet_server.cc:178] TabletServer@127.0.99.3:0 shutting down...
I20240503 08:01:24.970628 396 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:01:24.970826 396 tablet_replica.cc:330] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.970959 396 raft_consensus.cc:2229] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.971073 396 raft_consensus.cc:2258] T e18bdba1aeb848009b9c242b845d3eb9 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.971510 396 tablet_replica.cc:330] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.971599 396 raft_consensus.cc:2229] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.971689 396 raft_consensus.cc:2258] T 127c7f6ea3d342c8aa2d9bb4fc77ba0e P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.972002 396 tablet_replica.cc:330] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.972082 396 raft_consensus.cc:2229] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.972157 396 raft_consensus.cc:2258] T a8e0fa41a45d446ebb6a34130aa184a8 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.972427 396 tablet_replica.cc:330] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.972501 396 raft_consensus.cc:2229] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.972657 396 raft_consensus.cc:2258] T 2cdfaa9f47d54b5fb358f9aeccfc39ac P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.972944 396 tablet_replica.cc:330] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.973018 396 raft_consensus.cc:2229] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.973093 396 raft_consensus.cc:2258] T 7368bae6cc184be1baf0222034c2b644 P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.973363 396 tablet_replica.cc:330] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.973431 396 raft_consensus.cc:2229] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.973505 396 raft_consensus.cc:2258] T 963e451b93b44b04a305e4b5f5cd067e P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.973771 396 tablet_replica.cc:330] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.973841 396 raft_consensus.cc:2229] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.973917 396 raft_consensus.cc:2258] T e1263559849a402db75cab636b9e7612 P f9dd1504bffd41e8af78249a523a9403 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.974174 396 tablet_replica.cc:330] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.974242 396 raft_consensus.cc:2229] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:24.974315 396 raft_consensus.cc:2258] T 4bf11d78cba347d59218a6babf55f979 P f9dd1504bffd41e8af78249a523a9403 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.974582 396 tablet_replica.cc:330] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.974653 396 raft_consensus.cc:2229] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.974802 396 raft_consensus.cc:2258] T ed06dd84f5824f3c92340f5cc43175e8 P f9dd1504bffd41e8af78249a523a9403 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.975078 396 tablet_replica.cc:330] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403: stopping tablet replica
I20240503 08:01:24.975145 396 raft_consensus.cc:2229] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.975271 396 raft_consensus.cc:2258] T 37841eca10a74ac6b20bbca1751419fe P f9dd1504bffd41e8af78249a523a9403 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.989706 396 tablet_server.cc:194] TabletServer@127.0.99.3:0 shutdown complete.
I20240503 08:01:24.992645 396 master.cc:537] Master@127.0.99.62:36571 shutting down...
I20240503 08:01:24.995875 396 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:01:24.996022 396 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:24.996070 396 tablet_replica.cc:330] T 00000000000000000000000000000000 P ae3e2f0e03e245db8468d9afb8b40455: stopping tablet replica
I20240503 08:01:25.008204 396 master.cc:552] Master@127.0.99.62:36571 shutdown complete.
632b23a6349a4d009ea42004b6b51640 5
94538c84de4e4071a7eb04e9b29dc5ac 4
f9dd1504bffd41e8af78249a523a9403 1
632b23a6349a4d009ea42004b6b51640 4
94538c84de4e4071a7eb04e9b29dc5ac 3
f9dd1504bffd41e8af78249a523a9403 3
632b23a6349a4d009ea42004b6b51640 8
94538c84de4e4071a7eb04e9b29dc5ac 1
f9dd1504bffd41e8af78249a523a9403 1
632b23a6349a4d009ea42004b6b51640 4
94538c84de4e4071a7eb04e9b29dc5ac 3
f9dd1504bffd41e8af78249a523a9403 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (26827 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240503 08:01:25.017903 396 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.99.62:36027
I20240503 08:01:25.018278 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:01:25.021090 1360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:25.021761 1363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:25.022387 1361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:25.022887 396 server_base.cc:1034] running on GCE node
I20240503 08:01:25.023056 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:01:25.023090 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:01:25.023109 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723285023108 us; error 0 us; skew 500 ppm
I20240503 08:01:25.024091 396 webserver.cc:460] Webserver started at http://127.0.99.62:39509/ using document root <none> and password file <none>
I20240503 08:01:25.024247 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:01:25.024295 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:01:25.024365 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:01:25.024734 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/master-0-root/instance:
uuid: "348beb56cc4f40749d486eb15f667d04"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.026110 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.026996 1368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.027256 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.027329 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/master-0-root
uuid: "348beb56cc4f40749d486eb15f667d04"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.027395 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:01:25.034276 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:01:25.034598 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:01:25.038241 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.62:36027
I20240503 08:01:25.041533 1420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.62:36027 every 8 connection(s)
I20240503 08:01:25.042040 1421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.043838 1421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04: Bootstrap starting.
I20240503 08:01:25.044587 1421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.045501 1421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04: No bootstrap required, opened a new log
I20240503 08:01:25.045861 1421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "348beb56cc4f40749d486eb15f667d04" member_type: VOTER }
I20240503 08:01:25.045958 1421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.045992 1421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348beb56cc4f40749d486eb15f667d04, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.046110 1421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "348beb56cc4f40749d486eb15f667d04" member_type: VOTER }
I20240503 08:01:25.046175 1421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:01:25.046209 1421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:01:25.046252 1421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.046856 1421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "348beb56cc4f40749d486eb15f667d04" member_type: VOTER }
I20240503 08:01:25.046973 1421 leader_election.cc:302] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 348beb56cc4f40749d486eb15f667d04; no voters:
I20240503 08:01:25.047124 1421 leader_election.cc:288] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:01:25.047214 1424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.047392 1424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [term 1 LEADER]: Becoming Leader. State: Replica: 348beb56cc4f40749d486eb15f667d04, State: Running, Role: LEADER
I20240503 08:01:25.047542 1421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:01:25.047544 1424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "348beb56cc4f40749d486eb15f667d04" member_type: VOTER }
I20240503 08:01:25.047984 1425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "348beb56cc4f40749d486eb15f667d04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "348beb56cc4f40749d486eb15f667d04" member_type: VOTER } }
I20240503 08:01:25.048009 1426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 348beb56cc4f40749d486eb15f667d04. Latest consensus state: current_term: 1 leader_uuid: "348beb56cc4f40749d486eb15f667d04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "348beb56cc4f40749d486eb15f667d04" member_type: VOTER } }
I20240503 08:01:25.048079 1425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [sys.catalog]: This master's current role is: LEADER
I20240503 08:01:25.048090 1426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04 [sys.catalog]: This master's current role is: LEADER
I20240503 08:01:25.048324 1429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:01:25.049140 1429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:01:25.049335 396 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 08:01:25.050712 1429 catalog_manager.cc:1347] Generated new cluster ID: 47785be567b94d38895d5f73d46c2874
I20240503 08:01:25.050769 1429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:01:25.062789 1429 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:01:25.063341 1429 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:01:25.072949 1429 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 348beb56cc4f40749d486eb15f667d04: Generated new TSK 0
I20240503 08:01:25.073107 1429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:01:25.081506 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:01:25.084156 1442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:25.084753 1443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:25.085383 396 server_base.cc:1034] running on GCE node
W20240503 08:01:25.085896 1445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:25.086095 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:01:25.086146 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:01:25.086166 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723285086166 us; error 0 us; skew 500 ppm
I20240503 08:01:25.087062 396 webserver.cc:460] Webserver started at http://127.0.99.1:33571/ using document root <none> and password file <none>
I20240503 08:01:25.087215 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:01:25.087265 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:01:25.087338 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:01:25.087726 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root/instance:
uuid: "8f4fcb24282e423cb788be167a3540e7"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.089025 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.089838 1450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.090032 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.090093 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root
uuid: "8f4fcb24282e423cb788be167a3540e7"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.090154 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:01:25.098024 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:01:25.098299 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:01:25.098532 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:01:25.098925 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:01:25.098961 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.099004 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:01:25.099030 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.102788 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.1:34409
I20240503 08:01:25.102809 1513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.1:34409 every 8 connection(s)
I20240503 08:01:25.103569 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:01:25.106062 1518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:25.106752 1519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:25.107270 1521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:25.107622 1514 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36027
I20240503 08:01:25.107712 1514 heartbeater.cc:464] Registering TS with master...
I20240503 08:01:25.107815 396 server_base.cc:1034] running on GCE node
I20240503 08:01:25.107962 1514 heartbeater.cc:511] Master 127.0.99.62:36027 requested a full tablet report, sending...
I20240503 08:01:25.107985 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:01:25.108021 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:01:25.108040 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723285108039 us; error 0 us; skew 500 ppm
I20240503 08:01:25.108583 1385 ts_manager.cc:194] Registered new tserver with Master: 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:25.108985 396 webserver.cc:460] Webserver started at http://127.0.99.2:40327/ using document root <none> and password file <none>
I20240503 08:01:25.109145 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:01:25.109195 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:01:25.109259 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:01:25.109544 1385 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39790
I20240503 08:01:25.109653 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root/instance:
uuid: "171fd27a77964e6588327f262ecffc39"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.110971 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240503 08:01:25.111795 1526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.112038 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.112103 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root
uuid: "171fd27a77964e6588327f262ecffc39"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.112167 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:01:25.130259 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:01:25.130558 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:01:25.130832 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:01:25.131268 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:01:25.131304 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.131335 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:01:25.131361 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.135043 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.2:41553
I20240503 08:01:25.135084 1589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.2:41553 every 8 connection(s)
I20240503 08:01:25.135795 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:01:25.138306 1593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:25.138984 1594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:25.139384 1590 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36027
I20240503 08:01:25.139508 1590 heartbeater.cc:464] Registering TS with master...
W20240503 08:01:25.139606 1596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:25.139712 1590 heartbeater.cc:511] Master 127.0.99.62:36027 requested a full tablet report, sending...
I20240503 08:01:25.140118 396 server_base.cc:1034] running on GCE node
I20240503 08:01:25.140280 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20240503 08:01:25.140301 1385 ts_manager.cc:194] Registered new tserver with Master: 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
W20240503 08:01:25.140316 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:01:25.140383 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723285140382 us; error 0 us; skew 500 ppm
I20240503 08:01:25.140913 1385 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39806
I20240503 08:01:25.141443 396 webserver.cc:460] Webserver started at http://127.0.99.3:43109/ using document root <none> and password file <none>
I20240503 08:01:25.141602 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:01:25.141649 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:01:25.141782 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:01:25.142215 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root/instance:
uuid: "9f870be2d05c49bbab11db8ad76d6c89"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.143569 396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240503 08:01:25.144501 1601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.144706 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.144793 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root
uuid: "9f870be2d05c49bbab11db8ad76d6c89"
format_stamp: "Formatted at 2024-05-03 08:01:25 on dist-test-slave-gf01"
I20240503 08:01:25.144861 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:01:25.154763 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:01:25.155031 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:01:25.155265 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:01:25.155692 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:01:25.155728 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.155778 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:01:25.155807 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:25.159899 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.3:37627
I20240503 08:01:25.159926 1664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.3:37627 every 8 connection(s)
I20240503 08:01:25.163805 1665 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36027
I20240503 08:01:25.163890 1665 heartbeater.cc:464] Registering TS with master...
I20240503 08:01:25.164089 1665 heartbeater.cc:511] Master 127.0.99.62:36027 requested a full tablet report, sending...
I20240503 08:01:25.164611 1385 ts_manager.cc:194] Registered new tserver with Master: 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.164758 396 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004487609s
I20240503 08:01:25.165125 1385 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39812
I20240503 08:01:25.165192 396 test_util.cc:268] Using random seed: 541910151
I20240503 08:01:25.171859 1385 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39826:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 08:01:25.172791 1385 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 08:01:25.199882 1471 tablet_service.cc:1467] Processing CreateTablet for tablet 05394f63db6744a1921172d09e43e020 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 08:01:25.200491 1476 tablet_service.cc:1467] Processing CreateTablet for tablet ad66f33efc3e4033a129c6063b8845ba (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 08:01:25.200536 1627 tablet_service.cc:1467] Processing CreateTablet for tablet ad66f33efc3e4033a129c6063b8845ba (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 08:01:25.200713 1471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05394f63db6744a1921172d09e43e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.200764 1475 tablet_service.cc:1467] Processing CreateTablet for tablet c56e1683d2844f9b887ccccce86842f6 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 08:01:25.200820 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad66f33efc3e4033a129c6063b8845ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.201061 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 970a0c99cf944e55b89833ebb22db26b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 08:01:25.201678 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 293a1ffb916e457aacb4f84dae69cb32 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 08:01:25.201349 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 813ec1f7162b4b9e96f72c9ae496e387 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 08:01:25.202198 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c56e1683d2844f9b887ccccce86842f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.202585 1552 tablet_service.cc:1467] Processing CreateTablet for tablet ad66f33efc3e4033a129c6063b8845ba (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 08:01:25.202759 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 16cc735ddd4540ba9b3f9726c6a3e0a8 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 08:01:25.203615 1626 tablet_service.cc:1467] Processing CreateTablet for tablet 970a0c99cf944e55b89833ebb22db26b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 08:01:25.203683 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 3d3f7b80c0144221b60aac076bb330bd (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 08:01:25.203855 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d3f7b80c0144221b60aac076bb330bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.204043 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 813ec1f7162b4b9e96f72c9ae496e387 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 08:01:25.204417 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 293a1ffb916e457aacb4f84dae69cb32 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 08:01:25.204562 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 970a0c99cf944e55b89833ebb22db26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.204829 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 05394f63db6744a1921172d09e43e020 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 08:01:25.200129 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 3d3f7b80c0144221b60aac076bb330bd (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 08:01:25.205955 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d3f7b80c0144221b60aac076bb330bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.206001 1627 tablet_service.cc:1467] Processing CreateTablet for tablet c56e1683d2844f9b887ccccce86842f6 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 08:01:25.206465 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293a1ffb916e457aacb4f84dae69cb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.206933 1622 tablet_service.cc:1467] Processing CreateTablet for tablet 76e77365e9a143fbb8d43e3fd0308ffb (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 08:01:25.202926 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 970a0c99cf944e55b89833ebb22db26b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 08:01:25.207592 1682 tablet_bootstrap.cc:492] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.207741 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 970a0c99cf944e55b89833ebb22db26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.208326 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 813ec1f7162b4b9e96f72c9ae496e387. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.208531 1682 tablet_bootstrap.cc:654] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.208925 1621 tablet_service.cc:1467] Processing CreateTablet for tablet e3937ed53708473da219f5847f26a99d (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 08:01:25.200186 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 3d3f7b80c0144221b60aac076bb330bd (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 08:01:25.200309 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 16cc735ddd4540ba9b3f9726c6a3e0a8 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 08:01:25.199882 1470 tablet_service.cc:1467] Processing CreateTablet for tablet 76e77365e9a143fbb8d43e3fd0308ffb (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 08:01:25.209920 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16cc735ddd4540ba9b3f9726c6a3e0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.203855 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 970a0c99cf944e55b89833ebb22db26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.210175 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3937ed53708473da219f5847f26a99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.210294 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad66f33efc3e4033a129c6063b8845ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.210376 1472 tablet_service.cc:1467] Processing CreateTablet for tablet e3937ed53708473da219f5847f26a99d (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 08:01:25.210569 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3937ed53708473da219f5847f26a99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.200354 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 16cc735ddd4540ba9b3f9726c6a3e0a8 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 08:01:25.211937 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 813ec1f7162b4b9e96f72c9ae496e387. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.212045 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16cc735ddd4540ba9b3f9726c6a3e0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.212158 1470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e77365e9a143fbb8d43e3fd0308ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.202675 1551 tablet_service.cc:1467] Processing CreateTablet for tablet c56e1683d2844f9b887ccccce86842f6 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 08:01:25.213728 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e77365e9a143fbb8d43e3fd0308ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.213807 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c56e1683d2844f9b887ccccce86842f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.214140 1681 tablet_bootstrap.cc:492] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.214692 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05394f63db6744a1921172d09e43e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.214960 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 10154920cfd34910be91e017a7968233 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 08:01:25.215174 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10154920cfd34910be91e017a7968233. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.215353 1681 tablet_bootstrap.cc:654] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.203011 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 293a1ffb916e457aacb4f84dae69cb32 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 08:01:25.203079 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 813ec1f7162b4b9e96f72c9ae496e387 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 08:01:25.216553 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293a1ffb916e457aacb4f84dae69cb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.216866 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d3f7b80c0144221b60aac076bb330bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.217440 1681 tablet_bootstrap.cc:492] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.217517 1681 ts_tablet_manager.cc:1367] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.217950 1681 raft_consensus.cc:348] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.218056 1681 raft_consensus.cc:374] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.218087 1681 raft_consensus.cc:729] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.218267 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c56e1683d2844f9b887ccccce86842f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.218228 1681 consensus_queue.cc:260] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.218564 1681 ts_tablet_manager.cc:1398] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.218756 1514 heartbeater.cc:503] Master 127.0.99.62:36027 was elected leader, sending a full tablet report...
I20240503 08:01:25.218869 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16cc735ddd4540ba9b3f9726c6a3e0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.219661 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 813ec1f7162b4b9e96f72c9ae496e387. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.220784 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 418513984d364a129eebf2a2f49626b1 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 08:01:25.221026 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293a1ffb916e457aacb4f84dae69cb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.221186 1681 tablet_bootstrap.cc:492] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.217126 1682 tablet_bootstrap.cc:492] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.221367 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad66f33efc3e4033a129c6063b8845ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.222342 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 418513984d364a129eebf2a2f49626b1 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 08:01:25.222558 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418513984d364a129eebf2a2f49626b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.222815 1547 tablet_service.cc:1467] Processing CreateTablet for tablet 418513984d364a129eebf2a2f49626b1 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 08:01:25.223170 1547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418513984d364a129eebf2a2f49626b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.223831 1550 tablet_service.cc:1467] Processing CreateTablet for tablet e3937ed53708473da219f5847f26a99d (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 08:01:25.221024 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418513984d364a129eebf2a2f49626b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.224084 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 76e77365e9a143fbb8d43e3fd0308ffb (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 08:01:25.224206 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 10154920cfd34910be91e017a7968233 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 08:01:25.224041 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3937ed53708473da219f5847f26a99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.224485 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 05394f63db6744a1921172d09e43e020 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 08:01:25.224674 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05394f63db6744a1921172d09e43e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.225792 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10154920cfd34910be91e017a7968233. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.226181 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 10154920cfd34910be91e017a7968233 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 08:01:25.226302 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 793b3b6ea5a84982beaf5207f13f8e0b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 08:01:25.226392 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10154920cfd34910be91e017a7968233. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.226472 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 793b3b6ea5a84982beaf5207f13f8e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.227208 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e77365e9a143fbb8d43e3fd0308ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.228542 1681 tablet_bootstrap.cc:654] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.221354 1682 ts_tablet_manager.cc:1367] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20240503 08:01:25.228494 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 793b3b6ea5a84982beaf5207f13f8e0b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 08:01:25.228859 1680 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.228890 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 793b3b6ea5a84982beaf5207f13f8e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.229153 1682 raft_consensus.cc:348] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.229274 1682 raft_consensus.cc:374] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.229305 1682 raft_consensus.cc:729] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.229425 1682 consensus_queue.cc:260] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.229770 1682 ts_tablet_manager.cc:1398] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.229780 1680 tablet_bootstrap.cc:654] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.229931 1590 heartbeater.cc:503] Master 127.0.99.62:36027 was elected leader, sending a full tablet report...
I20240503 08:01:25.230612 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 589889a5006a4fccaa237697405fda28 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 08:01:25.230839 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 589889a5006a4fccaa237697405fda28. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.229961 1682 tablet_bootstrap.cc:492] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.231173 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 589889a5006a4fccaa237697405fda28 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 08:01:25.231360 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 589889a5006a4fccaa237697405fda28. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.231882 1682 tablet_bootstrap.cc:654] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.232650 1550 tablet_service.cc:1467] Processing CreateTablet for tablet b6c81a3f38a34cba88f04bc01c734427 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 08:01:25.232869 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c81a3f38a34cba88f04bc01c734427. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.233469 1470 tablet_service.cc:1467] Processing CreateTablet for tablet c52a1a85e18542c1b66458a67a9f79b7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 08:01:25.233580 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0f89b5529d4d879ec7f408870b466a (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 08:01:25.233680 1470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c52a1a85e18542c1b66458a67a9f79b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.233793 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0f89b5529d4d879ec7f408870b466a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.235612 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 5f4e300297e84663bcb1b718bfe537ce (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 08:01:25.235844 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4e300297e84663bcb1b718bfe537ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.236301 1476 tablet_service.cc:1467] Processing CreateTablet for tablet 2276ca9aefd240dca8eb751b715b6665 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 08:01:25.236510 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2276ca9aefd240dca8eb751b715b6665. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.236711 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0f89b5529d4d879ec7f408870b466a (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 08:01:25.236923 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0f89b5529d4d879ec7f408870b466a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.237226 1546 tablet_service.cc:1467] Processing CreateTablet for tablet 351717c2aada4ff691742452820f96f6 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 08:01:25.237442 1546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351717c2aada4ff691742452820f96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.237648 1547 tablet_service.cc:1467] Processing CreateTablet for tablet 5f4e300297e84663bcb1b718bfe537ce (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 08:01:25.237871 1547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4e300297e84663bcb1b718bfe537ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.238292 1471 tablet_service.cc:1467] Processing CreateTablet for tablet 8545dc5db5dd48fea2116afe19dd17c1 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 08:01:25.238494 1471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8545dc5db5dd48fea2116afe19dd17c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.238770 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 243ebc6725bc47faadf3e3a1c32a6859 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 08:01:25.238987 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243ebc6725bc47faadf3e3a1c32a6859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.239472 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 39bf366ef12b4fe2bd8db5591267de67 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 08:01:25.239684 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bf366ef12b4fe2bd8db5591267de67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.239732 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 243ebc6725bc47faadf3e3a1c32a6859 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 08:01:25.239954 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243ebc6725bc47faadf3e3a1c32a6859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.240832 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 8545dc5db5dd48fea2116afe19dd17c1 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 08:01:25.240875 1478 tablet_service.cc:1467] Processing CreateTablet for tablet d3c8c6ca18ca47d18e3650e09dac28cc (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 08:01:25.241045 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8545dc5db5dd48fea2116afe19dd17c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.241082 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c8c6ca18ca47d18e3650e09dac28cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.242484 1553 tablet_service.cc:1467] Processing CreateTablet for tablet c52a1a85e18542c1b66458a67a9f79b7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 08:01:25.242774 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c52a1a85e18542c1b66458a67a9f79b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.242830 1550 tablet_service.cc:1467] Processing CreateTablet for tablet d3c8c6ca18ca47d18e3650e09dac28cc (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 08:01:25.243013 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c8c6ca18ca47d18e3650e09dac28cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.242973 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 589889a5006a4fccaa237697405fda28 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 08:01:25.243192 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 589889a5006a4fccaa237697405fda28. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.243641 1628 tablet_service.cc:1467] Processing CreateTablet for tablet b6c81a3f38a34cba88f04bc01c734427 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 08:01:25.243862 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c81a3f38a34cba88f04bc01c734427. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.244199 1469 tablet_service.cc:1467] Processing CreateTablet for tablet 0285ac6e9f884a4abc7a272a664e2406 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 08:01:25.244314 1475 tablet_service.cc:1467] Processing CreateTablet for tablet 2a89ecf63c0a4ebba117030ea7c82610 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 08:01:25.244405 1469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0285ac6e9f884a4abc7a272a664e2406. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.244509 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 2936bd2bc39d4456a9886b2b10e9b4c0 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 08:01:25.244518 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a89ecf63c0a4ebba117030ea7c82610. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.245133 1472 tablet_service.cc:1467] Processing CreateTablet for tablet b6c81a3f38a34cba88f04bc01c734427 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 08:01:25.245360 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c81a3f38a34cba88f04bc01c734427. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.245795 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 39bf366ef12b4fe2bd8db5591267de67 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 08:01:25.245999 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bf366ef12b4fe2bd8db5591267de67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.246452 1475 tablet_service.cc:1467] Processing CreateTablet for tablet 07a79a5bc33441e0954896919f0e9da8 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 08:01:25.246657 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a79a5bc33441e0954896919f0e9da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.246985 1469 tablet_service.cc:1467] Processing CreateTablet for tablet a9277beceda64dc3af1f7d0ba9cf9249 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 08:01:25.247179 1469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9277beceda64dc3af1f7d0ba9cf9249. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.247131 1472 tablet_service.cc:1467] Processing CreateTablet for tablet fea8e975a53347df9e925173aeebaf61 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 08:01:25.247339 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea8e975a53347df9e925173aeebaf61. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.247671 1629 tablet_service.cc:1467] Processing CreateTablet for tablet d3c8c6ca18ca47d18e3650e09dac28cc (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 08:01:25.247895 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c8c6ca18ca47d18e3650e09dac28cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.248488 1471 tablet_service.cc:1467] Processing CreateTablet for tablet c219ee9b1aaf4c75a0581d9ea9fcc907 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 08:01:25.248872 1476 tablet_service.cc:1467] Processing CreateTablet for tablet 966ebd7eb10c4aef85de0b17abcbf686 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 08:01:25.248503 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2936bd2bc39d4456a9886b2b10e9b4c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.249080 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 966ebd7eb10c4aef85de0b17abcbf686. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.249708 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 351717c2aada4ff691742452820f96f6 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 08:01:25.230619 1681 tablet_bootstrap.cc:492] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.249915 1681 ts_tablet_manager.cc:1367] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20240503 08:01:25.249950 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351717c2aada4ff691742452820f96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.250378 1681 raft_consensus.cc:348] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.250483 1681 raft_consensus.cc:374] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.250514 1681 raft_consensus.cc:729] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.250630 1681 consensus_queue.cc:260] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.251032 1681 ts_tablet_manager.cc:1398] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.251261 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 2276ca9aefd240dca8eb751b715b6665 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 08:01:25.251538 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2276ca9aefd240dca8eb751b715b6665. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.251646 1622 tablet_service.cc:1467] Processing CreateTablet for tablet c52a1a85e18542c1b66458a67a9f79b7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 08:01:25.251863 1682 tablet_bootstrap.cc:492] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.251885 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c52a1a85e18542c1b66458a67a9f79b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.251951 1682 ts_tablet_manager.cc:1367] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.001s
I20240503 08:01:25.252370 1682 raft_consensus.cc:348] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.252480 1682 raft_consensus.cc:374] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.252533 1682 raft_consensus.cc:729] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.252549 1471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c219ee9b1aaf4c75a0581d9ea9fcc907. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.252650 1682 consensus_queue.cc:260] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.252907 1682 ts_tablet_manager.cc:1398] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.253070 1682 tablet_bootstrap.cc:492] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.253649 1622 tablet_service.cc:1467] Processing CreateTablet for tablet c219ee9b1aaf4c75a0581d9ea9fcc907 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 08:01:25.252487 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 39bf366ef12b4fe2bd8db5591267de67 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 08:01:25.253867 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c219ee9b1aaf4c75a0581d9ea9fcc907. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.253917 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39bf366ef12b4fe2bd8db5591267de67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.253963 1682 tablet_bootstrap.cc:654] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.254526 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 793b3b6ea5a84982beaf5207f13f8e0b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 08:01:25.254732 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 793b3b6ea5a84982beaf5207f13f8e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.254921 1682 tablet_bootstrap.cc:492] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.254990 1682 ts_tablet_manager.cc:1367] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:01:25.255367 1682 raft_consensus.cc:348] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.255474 1682 raft_consensus.cc:374] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.255506 1682 raft_consensus.cc:729] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.255592 1682 consensus_queue.cc:260] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.255652 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 2276ca9aefd240dca8eb751b715b6665 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 08:01:25.255872 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2276ca9aefd240dca8eb751b715b6665. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.255968 1682 ts_tablet_manager.cc:1398] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.256126 1682 tablet_bootstrap.cc:492] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.256501 1620 tablet_service.cc:1467] Processing CreateTablet for tablet 8545dc5db5dd48fea2116afe19dd17c1 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 08:01:25.256688 1621 tablet_service.cc:1467] Processing CreateTablet for tablet 243ebc6725bc47faadf3e3a1c32a6859 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 08:01:25.256784 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8545dc5db5dd48fea2116afe19dd17c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.256906 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243ebc6725bc47faadf3e3a1c32a6859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.256975 1682 tablet_bootstrap.cc:654] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.257705 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 2936bd2bc39d4456a9886b2b10e9b4c0 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 08:01:25.257931 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2936bd2bc39d4456a9886b2b10e9b4c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.257896 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 5f4e300297e84663bcb1b718bfe537ce (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 08:01:25.258095 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4e300297e84663bcb1b718bfe537ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.257678 1626 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0f89b5529d4d879ec7f408870b466a (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 08:01:25.258304 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0f89b5529d4d879ec7f408870b466a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.258679 1620 tablet_service.cc:1467] Processing CreateTablet for tablet 00be723293944a50ad14d0cb4b998fb5 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 08:01:25.258718 1621 tablet_service.cc:1467] Processing CreateTablet for tablet 2a89ecf63c0a4ebba117030ea7c82610 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 08:01:25.258879 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00be723293944a50ad14d0cb4b998fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.259919 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 0285ac6e9f884a4abc7a272a664e2406 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 08:01:25.260118 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0285ac6e9f884a4abc7a272a664e2406. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.260185 1626 tablet_service.cc:1467] Processing CreateTablet for tablet 07a79a5bc33441e0954896919f0e9da8 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 08:01:25.260386 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a79a5bc33441e0954896919f0e9da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.260613 1620 tablet_service.cc:1467] Processing CreateTablet for tablet a9277beceda64dc3af1f7d0ba9cf9249 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 08:01:25.260711 1624 tablet_service.cc:1467] Processing CreateTablet for tablet fea8e975a53347df9e925173aeebaf61 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 08:01:25.260816 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9277beceda64dc3af1f7d0ba9cf9249. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.260912 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea8e975a53347df9e925173aeebaf61. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.256502 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4576f5272c45089055f9f0d36db63c (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 08:01:25.261189 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4576f5272c45089055f9f0d36db63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.262358 1554 tablet_service.cc:1467] Processing CreateTablet for tablet c219ee9b1aaf4c75a0581d9ea9fcc907 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 08:01:25.262573 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c219ee9b1aaf4c75a0581d9ea9fcc907. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.263553 1547 tablet_service.cc:1467] Processing CreateTablet for tablet 0285ac6e9f884a4abc7a272a664e2406 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 08:01:25.263661 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4576f5272c45089055f9f0d36db63c (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 08:01:25.263697 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 966ebd7eb10c4aef85de0b17abcbf686 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 08:01:25.263772 1547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0285ac6e9f884a4abc7a272a664e2406. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.263902 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4576f5272c45089055f9f0d36db63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.263968 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 00be723293944a50ad14d0cb4b998fb5 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 08:01:25.264156 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00be723293944a50ad14d0cb4b998fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.264595 1546 tablet_service.cc:1467] Processing CreateTablet for tablet 07a79a5bc33441e0954896919f0e9da8 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 08:01:25.264822 1546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a79a5bc33441e0954896919f0e9da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.265769 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 2936bd2bc39d4456a9886b2b10e9b4c0 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 08:01:25.265990 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2936bd2bc39d4456a9886b2b10e9b4c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.266177 1682 tablet_bootstrap.cc:492] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.266255 1682 ts_tablet_manager.cc:1367] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240503 08:01:25.266690 1682 raft_consensus.cc:348] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.266806 1682 raft_consensus.cc:374] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.266839 1682 raft_consensus.cc:729] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.267172 1682 consensus_queue.cc:260] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.267225 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4576f5272c45089055f9f0d36db63c (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 08:01:25.267288 1545 tablet_service.cc:1467] Processing CreateTablet for tablet fea8e975a53347df9e925173aeebaf61 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 08:01:25.267421 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4576f5272c45089055f9f0d36db63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.267477 1682 ts_tablet_manager.cc:1398] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.267531 1545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea8e975a53347df9e925173aeebaf61. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.267881 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 2a89ecf63c0a4ebba117030ea7c82610 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 08:01:25.268093 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a89ecf63c0a4ebba117030ea7c82610. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.269006 1682 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.269454 1549 tablet_service.cc:1467] Processing CreateTablet for tablet a9277beceda64dc3af1f7d0ba9cf9249 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 08:01:25.269701 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9277beceda64dc3af1f7d0ba9cf9249. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.269893 1682 tablet_bootstrap.cc:654] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.269913 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 351717c2aada4ff691742452820f96f6 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 08:01:25.270112 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 966ebd7eb10c4aef85de0b17abcbf686. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.270129 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351717c2aada4ff691742452820f96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.272212 1470 tablet_service.cc:1467] Processing CreateTablet for tablet 00be723293944a50ad14d0cb4b998fb5 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 08:01:25.272426 1470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00be723293944a50ad14d0cb4b998fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.272749 1622 tablet_service.cc:1467] Processing CreateTablet for tablet 966ebd7eb10c4aef85de0b17abcbf686 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 08:01:25.273041 1682 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.273118 1682 ts_tablet_manager.cc:1367] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.272275 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a89ecf63c0a4ebba117030ea7c82610. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.273480 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 966ebd7eb10c4aef85de0b17abcbf686. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.273504 1682 raft_consensus.cc:348] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.273581 1682 raft_consensus.cc:374] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.273608 1682 raft_consensus.cc:729] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.273739 1682 consensus_queue.cc:260] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.273939 1681 tablet_bootstrap.cc:492] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.273988 1682 ts_tablet_manager.cc:1398] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.274133 1682 tablet_bootstrap.cc:492] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.274811 1681 tablet_bootstrap.cc:654] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.274953 1682 tablet_bootstrap.cc:654] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.276191 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 457808a6880d407a97940e0e5f87e46b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 08:01:25.276422 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 457808a6880d407a97940e0e5f87e46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.276510 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 457808a6880d407a97940e0e5f87e46b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 08:01:25.276775 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 457808a6880d407a97940e0e5f87e46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.277405 1680 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.277489 1680 ts_tablet_manager.cc:1367] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20240503 08:01:25.277894 1680 raft_consensus.cc:348] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.278008 1680 raft_consensus.cc:374] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.278048 1680 raft_consensus.cc:729] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.278164 1680 consensus_queue.cc:260] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.278509 1680 ts_tablet_manager.cc:1398] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.278510 1665 heartbeater.cc:503] Master 127.0.99.62:36027 was elected leader, sending a full tablet report...
I20240503 08:01:25.276507 1682 tablet_bootstrap.cc:492] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.278687 1680 tablet_bootstrap.cc:492] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.278753 1682 ts_tablet_manager.cc:1367] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240503 08:01:25.278909 1470 tablet_service.cc:1467] Processing CreateTablet for tablet 457808a6880d407a97940e0e5f87e46b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 08:01:25.279165 1682 raft_consensus.cc:348] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.279256 1682 raft_consensus.cc:374] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.279104 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 509a9c384f4c448a9fb048e0d6ff8563 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 08:01:25.279291 1682 raft_consensus.cc:729] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.279490 1682 consensus_queue.cc:260] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.279606 1680 tablet_bootstrap.cc:654] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.279744 1682 ts_tablet_manager.cc:1398] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.279888 1682 tablet_bootstrap.cc:492] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.280606 1680 tablet_bootstrap.cc:492] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.280638 1470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 457808a6880d407a97940e0e5f87e46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.281642 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 56853fdbc6ab40bdbcf146d71a8d8c72 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 08:01:25.280673 1682 tablet_bootstrap.cc:654] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.281852 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 509a9c384f4c448a9fb048e0d6ff8563 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 08:01:25.281991 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 509a9c384f4c448a9fb048e0d6ff8563 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 08:01:25.282099 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 509a9c384f4c448a9fb048e0d6ff8563. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.282210 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 509a9c384f4c448a9fb048e0d6ff8563. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.282505 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 509a9c384f4c448a9fb048e0d6ff8563. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.283530 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56853fdbc6ab40bdbcf146d71a8d8c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.280697 1680 ts_tablet_manager.cc:1367] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.284891 1680 raft_consensus.cc:348] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.285006 1680 raft_consensus.cc:374] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.285048 1680 raft_consensus.cc:729] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.285183 1680 consensus_queue.cc:260] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.285432 1680 ts_tablet_manager.cc:1398] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.285637 1680 tablet_bootstrap.cc:492] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.286485 1680 tablet_bootstrap.cc:654] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.287015 1681 tablet_bootstrap.cc:492] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.287016 1682 tablet_bootstrap.cc:492] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.287118 1681 ts_tablet_manager.cc:1367] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240503 08:01:25.287119 1682 ts_tablet_manager.cc:1367] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.287389 1470 tablet_service.cc:1467] Processing CreateTablet for tablet 32dcb8f792b747eeb0bcb0e3bec65e42 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 08:01:25.287545 1681 raft_consensus.cc:348] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.287647 1681 raft_consensus.cc:374] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.287693 1681 raft_consensus.cc:729] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.287766 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd482dfb6e04b6f8d40ddd3a9f03367 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 08:01:25.287571 1682 raft_consensus.cc:348] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.287927 1682 raft_consensus.cc:374] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.287968 1682 raft_consensus.cc:729] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.287829 1622 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd482dfb6e04b6f8d40ddd3a9f03367 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 08:01:25.288070 1628 tablet_service.cc:1467] Processing CreateTablet for tablet c3127e54a030482ab724e240c2b00c72 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 08:01:25.288239 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd482dfb6e04b6f8d40ddd3a9f03367. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.288703 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 56853fdbc6ab40bdbcf146d71a8d8c72 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 08:01:25.288720 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd482dfb6e04b6f8d40ddd3a9f03367 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 08:01:25.288921 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56853fdbc6ab40bdbcf146d71a8d8c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.288986 1550 tablet_service.cc:1467] Processing CreateTablet for tablet c3127e54a030482ab724e240c2b00c72 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 08:01:25.289146 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3127e54a030482ab724e240c2b00c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.290153 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3127e54a030482ab724e240c2b00c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.290392 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 39413e968c2548229bf4026e1c278d94 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 08:01:25.287804 1681 consensus_queue.cc:260] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.290807 1681 ts_tablet_manager.cc:1398] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.290963 1681 tablet_bootstrap.cc:492] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.290922 1621 tablet_service.cc:1467] Processing CreateTablet for tablet 56853fdbc6ab40bdbcf146d71a8d8c72 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 08:01:25.291136 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56853fdbc6ab40bdbcf146d71a8d8c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.291678 1472 tablet_service.cc:1467] Processing CreateTablet for tablet eb31c5818e7c45baacaf69e36a746fc7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 08:01:25.287644 1470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32dcb8f792b747eeb0bcb0e3bec65e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.292251 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd482dfb6e04b6f8d40ddd3a9f03367. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.292870 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39413e968c2548229bf4026e1c278d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.288076 1682 consensus_queue.cc:260] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.294070 1682 ts_tablet_manager.cc:1398] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.294239 1682 tablet_bootstrap.cc:492] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.295356 1682 tablet_bootstrap.cc:654] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.295292 1545 tablet_service.cc:1467] Processing CreateTablet for tablet 58bd5a282529408ebde35305325417ce (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 08:01:25.295542 1545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bd5a282529408ebde35305325417ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.295584 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 7091489ce2b94c82abd265d81c5e38d3 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 08:01:25.295621 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 160b79c11fcc46d79948b6e49888ec84 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 08:01:25.295784 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7091489ce2b94c82abd265d81c5e38d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.295833 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160b79c11fcc46d79948b6e49888ec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.296281 1682 tablet_bootstrap.cc:492] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.296345 1682 ts_tablet_manager.cc:1367] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:01:25.296770 1682 raft_consensus.cc:348] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.296854 1682 raft_consensus.cc:374] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.296882 1682 raft_consensus.cc:729] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.296980 1682 consensus_queue.cc:260] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.297204 1682 ts_tablet_manager.cc:1398] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.297340 1545 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0156bfa7c8465d80d93ab1301a0e67 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 08:01:25.297339 1682 tablet_bootstrap.cc:492] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.297581 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 907a3bdbd3454c4b8381fd68330bc2a0 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 08:01:25.297719 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 160b79c11fcc46d79948b6e49888ec84 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 08:01:25.297899 1626 tablet_service.cc:1467] Processing CreateTablet for tablet 480063e4cccc4173ad5a8d258ce204dc (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 08:01:25.297959 1549 tablet_service.cc:1467] Processing CreateTablet for tablet eb31c5818e7c45baacaf69e36a746fc7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 08:01:25.298105 1546 tablet_service.cc:1467] Processing CreateTablet for tablet 9a053f3bfd984b82b2d6ea6e833e2245 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 08:01:25.298092 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480063e4cccc4173ad5a8d258ce204dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.298449 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3745831794490b9318a7ba5e65c505 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 08:01:25.297729 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 7091489ce2b94c82abd265d81c5e38d3 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 08:01:25.298822 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7091489ce2b94c82abd265d81c5e38d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.298272 1547 tablet_service.cc:1467] Processing CreateTablet for tablet 480063e4cccc4173ad5a8d258ce204dc (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 08:01:25.297578 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 907a3bdbd3454c4b8381fd68330bc2a0 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 08:01:25.298267 1682 tablet_bootstrap.cc:654] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.295298 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0156bfa7c8465d80d93ab1301a0e67 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 08:01:25.299639 1680 tablet_bootstrap.cc:492] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.299710 1680 ts_tablet_manager.cc:1367] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20240503 08:01:25.298781 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 39413e968c2548229bf4026e1c278d94 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 08:01:25.300094 1626 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3ab6ff3aec423da20f2a55a038c5b2 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 08:01:25.300117 1680 raft_consensus.cc:348] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.300216 1680 raft_consensus.cc:374] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.300247 1680 raft_consensus.cc:729] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.300333 1680 consensus_queue.cc:260] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.300592 1680 ts_tablet_manager.cc:1398] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.300729 1680 tablet_bootstrap.cc:492] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.301059 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 7091489ce2b94c82abd265d81c5e38d3 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 08:01:25.301265 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7091489ce2b94c82abd265d81c5e38d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.301277 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 32dcb8f792b747eeb0bcb0e3bec65e42 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 08:01:25.301406 1469 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3745831794490b9318a7ba5e65c505 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 08:01:25.301596 1469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3745831794490b9318a7ba5e65c505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.301752 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 39413e968c2548229bf4026e1c278d94 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 08:01:25.298995 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907a3bdbd3454c4b8381fd68330bc2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.302512 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0156bfa7c8465d80d93ab1301a0e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.303076 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0156bfa7c8465d80d93ab1301a0e67 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 08:01:25.303277 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0156bfa7c8465d80d93ab1301a0e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.303628 1471 tablet_service.cc:1467] Processing CreateTablet for tablet 160b79c11fcc46d79948b6e49888ec84 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 08:01:25.303648 1475 tablet_service.cc:1467] Processing CreateTablet for tablet 480063e4cccc4173ad5a8d258ce204dc (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 08:01:25.303754 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 14a4c4ffcbd54a10b58312533628c560 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 08:01:25.303944 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a4c4ffcbd54a10b58312533628c560. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.303925 1476 tablet_service.cc:1467] Processing CreateTablet for tablet 9a053f3bfd984b82b2d6ea6e833e2245 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 08:01:25.304323 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 5af3e1b929d34152b04359d370772926 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 08:01:25.304519 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af3e1b929d34152b04359d370772926. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.304689 1622 tablet_service.cc:1467] Processing CreateTablet for tablet eb31c5818e7c45baacaf69e36a746fc7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 08:01:25.304903 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb31c5818e7c45baacaf69e36a746fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.306030 1680 tablet_bootstrap.cc:654] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.306241 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 71ba268c9b4c4e059c86d3804eb9513d (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 08:01:25.306444 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71ba268c9b4c4e059c86d3804eb9513d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.306838 1620 tablet_service.cc:1467] Processing CreateTablet for tablet 9a053f3bfd984b82b2d6ea6e833e2245 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 08:01:25.307056 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a053f3bfd984b82b2d6ea6e833e2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.307411 1545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0156bfa7c8465d80d93ab1301a0e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.308056 1547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480063e4cccc4173ad5a8d258ce204dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.308458 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3ab6ff3aec423da20f2a55a038c5b2 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 08:01:25.308686 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907a3bdbd3454c4b8381fd68330bc2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.308864 1620 tablet_service.cc:1467] Processing CreateTablet for tablet c436d20ad34f455ea1ac00e72e2118fd (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 08:01:25.309065 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c436d20ad34f455ea1ac00e72e2118fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.309131 1545 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3ab6ff3aec423da20f2a55a038c5b2 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 08:01:25.309314 1545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3ab6ff3aec423da20f2a55a038c5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.309859 1547 tablet_service.cc:1467] Processing CreateTablet for tablet 14a4c4ffcbd54a10b58312533628c560 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 08:01:25.310070 1547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a4c4ffcbd54a10b58312533628c560. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.310364 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 5af3e1b929d34152b04359d370772926 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 08:01:25.310559 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af3e1b929d34152b04359d370772926. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.310729 1620 tablet_service.cc:1467] Processing CreateTablet for tablet 12066e116ad446119c3e940a9ac37f12 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 08:01:25.310869 1545 tablet_service.cc:1467] Processing CreateTablet for tablet 71ba268c9b4c4e059c86d3804eb9513d (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 08:01:25.310940 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12066e116ad446119c3e940a9ac37f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.311056 1545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71ba268c9b4c4e059c86d3804eb9513d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.311499 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb31c5818e7c45baacaf69e36a746fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.311622 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3745831794490b9318a7ba5e65c505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.304502 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 58bd5a282529408ebde35305325417ce (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 08:01:25.311728 1623 tablet_service.cc:1467] Processing CreateTablet for tablet a64a657fff614834aabcb06e2197030b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 08:01:25.311910 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39413e968c2548229bf4026e1c278d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.311728 1471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160b79c11fcc46d79948b6e49888ec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.312214 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160b79c11fcc46d79948b6e49888ec84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.312278 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480063e4cccc4173ad5a8d258ce204dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.303377 1469 tablet_service.cc:1467] Processing CreateTablet for tablet 907a3bdbd3454c4b8381fd68330bc2a0 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 08:01:25.312680 1469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907a3bdbd3454c4b8381fd68330bc2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.312726 1546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a053f3bfd984b82b2d6ea6e833e2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.312772 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bd5a282529408ebde35305325417ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.313200 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a053f3bfd984b82b2d6ea6e833e2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.313501 1547 tablet_service.cc:1467] Processing CreateTablet for tablet c436d20ad34f455ea1ac00e72e2118fd (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 08:01:25.313697 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32dcb8f792b747eeb0bcb0e3bec65e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.313897 1621 tablet_service.cc:1467] Processing CreateTablet for tablet 32dcb8f792b747eeb0bcb0e3bec65e42 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 08:01:25.314133 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb31c5818e7c45baacaf69e36a746fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.313699 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3ab6ff3aec423da20f2a55a038c5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.314414 1547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c436d20ad34f455ea1ac00e72e2118fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.314441 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 12066e116ad446119c3e940a9ac37f12 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 08:01:25.314635 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12066e116ad446119c3e940a9ac37f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.314949 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39413e968c2548229bf4026e1c278d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.314903 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64a657fff614834aabcb06e2197030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.314982 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 96ee17f54468471aaffac608f360a090 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 08:01:25.315181 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3ab6ff3aec423da20f2a55a038c5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.315181 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ee17f54468471aaffac608f360a090. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.315515 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32dcb8f792b747eeb0bcb0e3bec65e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.316005 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 5e7cc8dc5aae46b3903508c4060666d7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 08:01:25.316190 1682 tablet_bootstrap.cc:492] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.316279 1682 ts_tablet_manager.cc:1367] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20240503 08:01:25.316483 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e7cc8dc5aae46b3903508c4060666d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.316540 1554 tablet_service.cc:1467] Processing CreateTablet for tablet a64a657fff614834aabcb06e2197030b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 08:01:25.316777 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64a657fff614834aabcb06e2197030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.316803 1682 raft_consensus.cc:348] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.316902 1682 raft_consensus.cc:374] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.316941 1682 raft_consensus.cc:729] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.317252 1470 tablet_service.cc:1467] Processing CreateTablet for tablet 14a4c4ffcbd54a10b58312533628c560 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 08:01:25.317301 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3745831794490b9318a7ba5e65c505 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 08:01:25.317505 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3745831794490b9318a7ba5e65c505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.318675 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 96ee17f54468471aaffac608f360a090 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 08:01:25.318890 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ee17f54468471aaffac608f360a090. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.320011 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 5e7cc8dc5aae46b3903508c4060666d7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 08:01:25.320220 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e7cc8dc5aae46b3903508c4060666d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.322486 1681 tablet_bootstrap.cc:654] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.322754 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd482dfb6e04b6f8d40ddd3a9f03367. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.324405 1682 consensus_queue.cc:260] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.324599 1697 raft_consensus.cc:482] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.324673 1697 raft_consensus.cc:504] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.325105 1682 ts_tablet_manager.cc:1398] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20240503 08:01:25.325161 1697 leader_election.cc:288] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.325274 1682 tablet_bootstrap.cc:492] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.326107 1682 tablet_bootstrap.cc:654] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.326627 1475 tablet_service.cc:1467] Processing CreateTablet for tablet 5af3e1b929d34152b04359d370772926 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 08:01:25.326839 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af3e1b929d34152b04359d370772926. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.327263 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 71ba268c9b4c4e059c86d3804eb9513d (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 08:01:25.327497 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71ba268c9b4c4e059c86d3804eb9513d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.328584 1475 tablet_service.cc:1467] Processing CreateTablet for tablet c436d20ad34f455ea1ac00e72e2118fd (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 08:01:25.328790 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c436d20ad34f455ea1ac00e72e2118fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.329138 1682 tablet_bootstrap.cc:492] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.329214 1682 ts_tablet_manager.cc:1367] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:01:25.329296 1472 tablet_service.cc:1467] Processing CreateTablet for tablet 12066e116ad446119c3e940a9ac37f12 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 08:01:25.329509 1472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12066e116ad446119c3e940a9ac37f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.329624 1682 raft_consensus.cc:348] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.329716 1682 raft_consensus.cc:374] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.329746 1682 raft_consensus.cc:729] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.329864 1682 consensus_queue.cc:260] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.330134 1682 ts_tablet_manager.cc:1398] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.330297 1682 tablet_bootstrap.cc:492] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.330490 1475 tablet_service.cc:1467] Processing CreateTablet for tablet a64a657fff614834aabcb06e2197030b (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 08:01:25.330130 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ec1f7162b4b9e96f72c9ae496e387" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.330691 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64a657fff614834aabcb06e2197030b. 1 dirs total, 0 dirs full, 0 dirs failed
W20240503 08:01:25.330987 1604 leader_election.cc:341] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.331111 1682 tablet_bootstrap.cc:654] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.331732 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 96ee17f54468471aaffac608f360a090 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 08:01:25.331962 1476 tablet_service.cc:1467] Processing CreateTablet for tablet 5e7cc8dc5aae46b3903508c4060666d7 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 08:01:25.332710 1682 tablet_bootstrap.cc:492] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.332796 1682 ts_tablet_manager.cc:1367] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.333204 1682 raft_consensus.cc:348] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.333308 1682 raft_consensus.cc:374] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.333349 1682 raft_consensus.cc:729] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.333468 1682 consensus_queue.cc:260] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.333736 1682 ts_tablet_manager.cc:1398] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.333902 1682 tablet_bootstrap.cc:492] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.334000 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ec1f7162b4b9e96f72c9ae496e387" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.334106 1564 raft_consensus.cc:2454] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.334375 1602 leader_election.cc:302] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.334601 1697 raft_consensus.cc:2781] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.334656 1697 raft_consensus.cc:482] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.334702 1697 raft_consensus.cc:3037] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.334748 1682 tablet_bootstrap.cc:654] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.286635 1473 tablet_service.cc:1467] Processing CreateTablet for tablet c3127e54a030482ab724e240c2b00c72 (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 08:01:25.335567 1697 raft_consensus.cc:504] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.335834 1682 tablet_bootstrap.cc:492] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.335911 1697 leader_election.cc:288] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.335916 1682 ts_tablet_manager.cc:1367] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.336398 1682 raft_consensus.cc:348] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.336498 1682 raft_consensus.cc:374] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.336539 1682 raft_consensus.cc:729] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.336563 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ec1f7162b4b9e96f72c9ae496e387" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.336647 1564 raft_consensus.cc:3037] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.336645 1682 consensus_queue.cc:260] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.336972 1682 ts_tablet_manager.cc:1398] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.337124 1682 tablet_bootstrap.cc:492] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.331955 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ee17f54468471aaffac608f360a090. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.337435 1564 raft_consensus.cc:2454] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.337437 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e7cc8dc5aae46b3903508c4060666d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.337708 1602 leader_election.cc:302] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.337942 1682 tablet_bootstrap.cc:654] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.338173 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ec1f7162b4b9e96f72c9ae496e387" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
W20240503 08:01:25.338462 1604 leader_election.cc:341] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.338634 1697 raft_consensus.cc:2781] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.338766 1470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a4c4ffcbd54a10b58312533628c560. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.338807 1697 raft_consensus.cc:686] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.338936 1682 tablet_bootstrap.cc:492] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.338929 1697 consensus_queue.cc:237] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.339027 1682 ts_tablet_manager.cc:1367] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:01:25.339375 1682 raft_consensus.cc:348] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.339506 1682 raft_consensus.cc:374] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.339550 1682 raft_consensus.cc:729] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.339655 1682 consensus_queue.cc:260] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.339910 1682 ts_tablet_manager.cc:1398] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.340055 1682 tablet_bootstrap.cc:492] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.340883 1682 tablet_bootstrap.cc:654] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.341392 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3127e54a030482ab724e240c2b00c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.341821 1682 tablet_bootstrap.cc:492] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.341902 1682 ts_tablet_manager.cc:1367] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.342286 1682 raft_consensus.cc:348] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.341305 1383 catalog_manager.cc:5484] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.343048 1682 raft_consensus.cc:374] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.343102 1682 raft_consensus.cc:729] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.343230 1682 consensus_queue.cc:260] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.343572 1682 ts_tablet_manager.cc:1398] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.343729 1682 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.344489 1682 tablet_bootstrap.cc:654] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.344893 1681 tablet_bootstrap.cc:492] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.344977 1681 ts_tablet_manager.cc:1367] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20240503 08:01:25.345203 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 58bd5a282529408ebde35305325417ce (DEFAULT_TABLE table=test-workload [id=868d672af79a46b68dd9177096807175]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 08:01:25.345374 1681 raft_consensus.cc:348] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.345481 1681 raft_consensus.cc:374] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.345517 1681 raft_consensus.cc:729] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.345651 1681 consensus_queue.cc:260] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.345808 1682 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.345911 1680 tablet_bootstrap.cc:492] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.346082 1680 ts_tablet_manager.cc:1367] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.002s
I20240503 08:01:25.346393 1681 ts_tablet_manager.cc:1398] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.346474 1680 raft_consensus.cc:348] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.346554 1680 raft_consensus.cc:374] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.346544 1681 tablet_bootstrap.cc:492] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.346606 1680 raft_consensus.cc:729] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.346706 1680 consensus_queue.cc:260] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.346961 1680 ts_tablet_manager.cc:1398] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.345431 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58bd5a282529408ebde35305325417ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:25.347136 1680 tablet_bootstrap.cc:492] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.345911 1682 ts_tablet_manager.cc:1367] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.347819 1681 tablet_bootstrap.cc:654] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.348094 1682 raft_consensus.cc:348] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.348208 1682 raft_consensus.cc:374] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.348260 1682 raft_consensus.cc:729] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.348469 1680 tablet_bootstrap.cc:654] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.348424 1682 consensus_queue.cc:260] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.349522 1680 tablet_bootstrap.cc:492] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.349601 1680 ts_tablet_manager.cc:1367] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.349969 1680 raft_consensus.cc:348] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.350062 1680 raft_consensus.cc:374] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.350095 1680 raft_consensus.cc:729] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.350188 1680 consensus_queue.cc:260] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.350483 1680 ts_tablet_manager.cc:1398] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.350629 1680 tablet_bootstrap.cc:492] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.351500 1680 tablet_bootstrap.cc:654] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.352111 1682 ts_tablet_manager.cc:1398] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.352279 1682 tablet_bootstrap.cc:492] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.352365 1681 tablet_bootstrap.cc:492] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.352452 1681 ts_tablet_manager.cc:1367] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240503 08:01:25.352649 1680 tablet_bootstrap.cc:492] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.352787 1680 ts_tablet_manager.cc:1367] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:01:25.352851 1681 raft_consensus.cc:348] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.352945 1681 raft_consensus.cc:374] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.352990 1681 raft_consensus.cc:729] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.353103 1681 consensus_queue.cc:260] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.353183 1682 tablet_bootstrap.cc:654] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.353344 1681 ts_tablet_manager.cc:1398] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20240503 08:01:25.353365 1515 tablet.cc:2369] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240503 08:01:25.353502 1680 raft_consensus.cc:348] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.353570 1681 tablet_bootstrap.cc:492] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.353588 1680 raft_consensus.cc:374] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.353617 1680 raft_consensus.cc:729] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.353740 1680 consensus_queue.cc:260] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.354521 1682 tablet_bootstrap.cc:492] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.354555 1681 tablet_bootstrap.cc:654] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.354593 1682 ts_tablet_manager.cc:1367] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.354986 1682 raft_consensus.cc:348] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.355074 1682 raft_consensus.cc:374] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.355111 1682 raft_consensus.cc:729] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.355208 1682 consensus_queue.cc:260] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.355517 1682 ts_tablet_manager.cc:1398] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.355683 1682 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.355885 1681 tablet_bootstrap.cc:492] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.355980 1680 ts_tablet_manager.cc:1398] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240503 08:01:25.356011 1681 ts_tablet_manager.cc:1367] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:01:25.356483 1682 tablet_bootstrap.cc:654] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.356443 1681 raft_consensus.cc:348] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.356547 1681 raft_consensus.cc:374] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.356588 1681 raft_consensus.cc:729] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.356734 1681 consensus_queue.cc:260] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.357283 1681 ts_tablet_manager.cc:1398] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.357407 1682 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.357434 1681 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.357474 1682 ts_tablet_manager.cc:1367] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.357848 1682 raft_consensus.cc:348] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.357933 1682 raft_consensus.cc:374] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.357964 1682 raft_consensus.cc:729] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.358064 1682 consensus_queue.cc:260] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.358261 1681 tablet_bootstrap.cc:654] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.358285 1682 ts_tablet_manager.cc:1398] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.358422 1682 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.359125 1680 tablet_bootstrap.cc:492] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.359287 1681 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.359408 1681 ts_tablet_manager.cc:1367] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.359858 1681 raft_consensus.cc:348] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.359998 1680 tablet_bootstrap.cc:654] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.359321 1682 tablet_bootstrap.cc:654] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.360016 1681 raft_consensus.cc:374] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.360152 1681 raft_consensus.cc:729] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.360327 1681 consensus_queue.cc:260] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.360643 1681 ts_tablet_manager.cc:1398] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.360858 1681 tablet_bootstrap.cc:492] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.361572 1681 tablet_bootstrap.cc:654] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.362530 1682 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.362558 1681 tablet_bootstrap.cc:492] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.362603 1682 ts_tablet_manager.cc:1367] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.362630 1681 ts_tablet_manager.cc:1367] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.362941 1682 raft_consensus.cc:348] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.363019 1682 raft_consensus.cc:374] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.363049 1682 raft_consensus.cc:729] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.363044 1681 raft_consensus.cc:348] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.363152 1681 raft_consensus.cc:374] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.363201 1681 raft_consensus.cc:729] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.363183 1682 consensus_queue.cc:260] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.363330 1680 tablet_bootstrap.cc:492] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.363310 1681 consensus_queue.cc:260] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.363401 1680 ts_tablet_manager.cc:1367] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.363416 1682 ts_tablet_manager.cc:1398] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.363561 1681 ts_tablet_manager.cc:1398] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.363579 1682 tablet_bootstrap.cc:492] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.363799 1681 tablet_bootstrap.cc:492] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.363775 1680 raft_consensus.cc:348] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.363860 1680 raft_consensus.cc:374] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.363881 1680 raft_consensus.cc:729] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.363988 1680 consensus_queue.cc:260] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.364199 1680 ts_tablet_manager.cc:1398] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.364370 1680 tablet_bootstrap.cc:492] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.364554 1682 tablet_bootstrap.cc:654] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.365209 1681 tablet_bootstrap.cc:654] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.365267 1680 tablet_bootstrap.cc:654] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.366537 1689 raft_consensus.cc:482] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.366611 1689 raft_consensus.cc:504] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.367048 1682 tablet_bootstrap.cc:492] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.367112 1689 leader_election.cc:288] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.367048 1681 tablet_bootstrap.cc:492] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.367578 1681 ts_tablet_manager.cc:1367] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.367935 1682 ts_tablet_manager.cc:1367] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240503 08:01:25.367975 1681 raft_consensus.cc:348] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.368057 1681 raft_consensus.cc:374] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.368084 1681 raft_consensus.cc:729] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.368206 1681 consensus_queue.cc:260] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.368324 1682 raft_consensus.cc:348] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.368396 1682 raft_consensus.cc:374] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.368424 1682 raft_consensus.cc:729] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.368526 1681 ts_tablet_manager.cc:1398] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.368520 1682 consensus_queue.cc:260] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.368687 1681 tablet_bootstrap.cc:492] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.368769 1682 ts_tablet_manager.cc:1398] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.368903 1682 tablet_bootstrap.cc:492] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.369575 1681 tablet_bootstrap.cc:654] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.369819 1682 tablet_bootstrap.cc:654] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.370559 1680 tablet_bootstrap.cc:492] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.370617 1680 ts_tablet_manager.cc:1367] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20240503 08:01:25.370898 1680 raft_consensus.cc:348] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.370977 1680 raft_consensus.cc:374] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.371006 1680 raft_consensus.cc:729] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.371098 1680 consensus_queue.cc:260] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.371315 1680 ts_tablet_manager.cc:1398] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.371809 1680 tablet_bootstrap.cc:492] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.371816 1681 tablet_bootstrap.cc:492] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.372009 1681 ts_tablet_manager.cc:1367] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.372262 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05394f63db6744a1921172d09e43e020" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.372383 1639 raft_consensus.cc:2454] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.372630 1680 tablet_bootstrap.cc:654] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.372716 1452 leader_election.cc:302] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.372872 1689 raft_consensus.cc:2781] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.372917 1689 raft_consensus.cc:482] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.372918 1682 tablet_bootstrap.cc:492] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.372980 1689 raft_consensus.cc:3037] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.373024 1682 ts_tablet_manager.cc:1367] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:01:25.373313 1682 raft_consensus.cc:348] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.373384 1682 raft_consensus.cc:374] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.373404 1682 raft_consensus.cc:729] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.373490 1682 consensus_queue.cc:260] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.373920 1689 raft_consensus.cc:504] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.374089 1682 ts_tablet_manager.cc:1398] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.374239 1682 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.374264 1689 leader_election.cc:288] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.374605 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05394f63db6744a1921172d09e43e020" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.374691 1639 raft_consensus.cc:3037] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.375653 1682 tablet_bootstrap.cc:654] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.375919 1639 raft_consensus.cc:2454] T 05394f63db6744a1921172d09e43e020 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.376192 1452 leader_election.cc:302] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.376336 1685 raft_consensus.cc:482] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.376405 1685 raft_consensus.cc:504] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.376600 1682 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.376678 1682 ts_tablet_manager.cc:1367] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.376754 1685 leader_election.cc:288] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.376775 1689 raft_consensus.cc:2781] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.376845 1689 raft_consensus.cc:686] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.376981 1689 consensus_queue.cc:237] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.377015 1682 raft_consensus.cc:348] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.377082 1682 raft_consensus.cc:374] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.377100 1682 raft_consensus.cc:729] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.377183 1682 consensus_queue.cc:260] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.377218 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ec1f7162b4b9e96f72c9ae496e387" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.377642 1691 raft_consensus.cc:482] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.377707 1691 raft_consensus.cc:504] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.377816 1682 ts_tablet_manager.cc:1398] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.377974 1682 tablet_bootstrap.cc:492] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.378100 1691 leader_election.cc:288] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.378422 1385 catalog_manager.cc:5484] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.378748 1682 tablet_bootstrap.cc:654] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.372371 1681 raft_consensus.cc:348] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.378932 1681 raft_consensus.cc:374] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.378988 1681 raft_consensus.cc:729] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.379091 1681 consensus_queue.cc:260] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.379331 1681 ts_tablet_manager.cc:1398] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.379498 1681 tablet_bootstrap.cc:492] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.379662 1682 tablet_bootstrap.cc:492] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.379743 1682 ts_tablet_manager.cc:1367] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.380115 1682 raft_consensus.cc:348] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.380209 1682 raft_consensus.cc:374] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.380250 1681 tablet_bootstrap.cc:654] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.380244 1682 raft_consensus.cc:729] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.380409 1682 consensus_queue.cc:260] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.380646 1682 ts_tablet_manager.cc:1398] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.380784 1682 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.381717 1682 tablet_bootstrap.cc:654] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.382756 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c56e1683d2844f9b887ccccce86842f6" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.382875 1488 raft_consensus.cc:2454] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.383083 1529 leader_election.cc:302] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.383229 1691 raft_consensus.cc:2781] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.383278 1691 raft_consensus.cc:482] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.383304 1691 raft_consensus.cc:3037] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.384079 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05394f63db6744a1921172d09e43e020" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.384212 1680 tablet_bootstrap.cc:492] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.384177 1691 raft_consensus.cc:504] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.384279 1680 ts_tablet_manager.cc:1367] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20240503 08:01:25.384260 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05394f63db6744a1921172d09e43e020" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.384476 1691 leader_election.cc:288] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.384485 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "813ec1f7162b4b9e96f72c9ae496e387" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.384179 1564 raft_consensus.cc:2454] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.384661 1680 raft_consensus.cc:348] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.384709 1562 raft_consensus.cc:2379] T 813ec1f7162b4b9e96f72c9ae496e387 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f4fcb24282e423cb788be167a3540e7 in current term 1: Already voted for candidate 9f870be2d05c49bbab11db8ad76d6c89 in this term.
I20240503 08:01:25.384763 1680 raft_consensus.cc:374] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.384799 1680 raft_consensus.cc:729] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.384919 1680 consensus_queue.cc:260] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.385164 1680 ts_tablet_manager.cc:1398] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.385251 1451 leader_election.cc:302] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7; no voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.385316 1680 tablet_bootstrap.cc:492] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.385452 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c56e1683d2844f9b887ccccce86842f6" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.385532 1488 raft_consensus.cc:3037] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.386130 1680 tablet_bootstrap.cc:654] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.386369 1488 raft_consensus.cc:2454] T c56e1683d2844f9b887ccccce86842f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.386723 1529 leader_election.cc:302] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.386862 1691 raft_consensus.cc:2781] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.386915 1689 raft_consensus.cc:3037] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.386950 1691 raft_consensus.cc:686] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.387039 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c56e1683d2844f9b887ccccce86842f6" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.387063 1691 consensus_queue.cc:237] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.387125 1639 raft_consensus.cc:2454] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.387406 1680 tablet_bootstrap.cc:492] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.387524 1680 ts_tablet_manager.cc:1367] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:01:25.387653 1689 raft_consensus.cc:2726] T 813ec1f7162b4b9e96f72c9ae496e387 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.386895 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c56e1683d2844f9b887ccccce86842f6" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.387782 1638 raft_consensus.cc:3037] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.388334 1680 raft_consensus.cc:348] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.388419 1680 raft_consensus.cc:374] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.388446 1680 raft_consensus.cc:729] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.388550 1680 consensus_queue.cc:260] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.388800 1680 ts_tablet_manager.cc:1398] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.388852 1638 raft_consensus.cc:2454] T c56e1683d2844f9b887ccccce86842f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.388880 1691 raft_consensus.cc:482] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.388978 1680 tablet_bootstrap.cc:492] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.388947 1691 raft_consensus.cc:504] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.389222 1691 leader_election.cc:288] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.389467 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4e300297e84663bcb1b718bfe537ce" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
W20240503 08:01:25.389720 1529 leader_election.cc:341] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.390334 1385 catalog_manager.cc:5484] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.390661 1680 tablet_bootstrap.cc:654] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.391628 1680 tablet_bootstrap.cc:492] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.391644 1681 tablet_bootstrap.cc:492] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.391701 1680 ts_tablet_manager.cc:1367] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.391712 1681 ts_tablet_manager.cc:1367] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20240503 08:01:25.392066 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4e300297e84663bcb1b718bfe537ce" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.392110 1680 raft_consensus.cc:348] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.392212 1680 raft_consensus.cc:374] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.392129 1681 raft_consensus.cc:348] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.392251 1680 raft_consensus.cc:729] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.392267 1681 raft_consensus.cc:374] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.392307 1681 raft_consensus.cc:729] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
W20240503 08:01:25.392354 1528 leader_election.cc:341] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.392345 1680 consensus_queue.cc:260] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.392441 1528 leader_election.cc:302] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.392414 1681 consensus_queue.cc:260] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.392617 1691 raft_consensus.cc:2726] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.392671 1681 ts_tablet_manager.cc:1398] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.392854 1681 tablet_bootstrap.cc:492] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.392997 1680 ts_tablet_manager.cc:1398] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.393154 1680 tablet_bootstrap.cc:492] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.393671 1681 tablet_bootstrap.cc:654] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.393990 1680 tablet_bootstrap.cc:654] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.394901 1680 tablet_bootstrap.cc:492] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.395010 1680 ts_tablet_manager.cc:1367] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:01:25.394901 1682 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.395171 1682 ts_tablet_manager.cc:1367] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240503 08:01:25.395524 1681 tablet_bootstrap.cc:492] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.395491 1680 raft_consensus.cc:348] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.395576 1680 raft_consensus.cc:374] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.395601 1681 ts_tablet_manager.cc:1367] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240503 08:01:25.395712 1682 raft_consensus.cc:348] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.395771 1682 raft_consensus.cc:374] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.395789 1682 raft_consensus.cc:729] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.395874 1682 consensus_queue.cc:260] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.396011 1681 raft_consensus.cc:348] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.395606 1680 raft_consensus.cc:729] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.396106 1682 ts_tablet_manager.cc:1398] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.396237 1680 consensus_queue.cc:260] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.396299 1682 tablet_bootstrap.cc:492] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.396553 1680 ts_tablet_manager.cc:1398] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.396733 1680 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.397128 1682 tablet_bootstrap.cc:654] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.397538 1680 tablet_bootstrap.cc:654] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.398015 1682 tablet_bootstrap.cc:492] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.398105 1682 ts_tablet_manager.cc:1367] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.398423 1682 raft_consensus.cc:348] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.398494 1680 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.398511 1682 raft_consensus.cc:374] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.398543 1682 raft_consensus.cc:729] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.398559 1680 ts_tablet_manager.cc:1367] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.398645 1682 consensus_queue.cc:260] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.398885 1682 ts_tablet_manager.cc:1398] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.396106 1681 raft_consensus.cc:374] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.398947 1680 raft_consensus.cc:348] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.399015 1681 raft_consensus.cc:729] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.399030 1680 raft_consensus.cc:374] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.399061 1680 raft_consensus.cc:729] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.399116 1682 tablet_bootstrap.cc:492] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.399127 1681 consensus_queue.cc:260] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.399184 1680 consensus_queue.cc:260] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.398895 1689 raft_consensus.cc:482] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.399511 1680 ts_tablet_manager.cc:1398] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.399524 1689 raft_consensus.cc:504] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.399649 1680 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.399842 1689 leader_election.cc:288] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.399931 1681 ts_tablet_manager.cc:1398] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.399994 1682 tablet_bootstrap.cc:654] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.400094 1681 tablet_bootstrap.cc:492] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.400182 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad66f33efc3e4033a129c6063b8845ba" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.400310 1638 raft_consensus.cc:2454] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.400574 1691 raft_consensus.cc:482] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.400651 1691 raft_consensus.cc:504] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.400883 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad66f33efc3e4033a129c6063b8845ba" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.400966 1691 leader_election.cc:288] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.400995 1562 raft_consensus.cc:2454] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.401361 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8545dc5db5dd48fea2116afe19dd17c1" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.401511 1680 tablet_bootstrap.cc:654] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
W20240503 08:01:25.401639 1529 leader_election.cc:341] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.401762 1451 leader_election.cc:302] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.401888 1689 raft_consensus.cc:2781] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.401930 1689 raft_consensus.cc:482] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.401978 1689 raft_consensus.cc:3037] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.402815 1689 raft_consensus.cc:504] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.403033 1680 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.403103 1680 ts_tablet_manager.cc:1367] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.403393 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad66f33efc3e4033a129c6063b8845ba" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.403522 1639 raft_consensus.cc:3037] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.403646 1680 raft_consensus.cc:348] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.403750 1680 raft_consensus.cc:374] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.403787 1680 raft_consensus.cc:729] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.403921 1680 consensus_queue.cc:260] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.404248 1682 tablet_bootstrap.cc:492] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.404297 1639 raft_consensus.cc:2454] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.404326 1682 ts_tablet_manager.cc:1367] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:01:25.401983 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8545dc5db5dd48fea2116afe19dd17c1" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.404628 1452 leader_election.cc:302] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
W20240503 08:01:25.404676 1528 leader_election.cc:341] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.404733 1528 leader_election.cc:302] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.404889 1691 raft_consensus.cc:2726] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.404742 1682 raft_consensus.cc:348] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.404769 1685 raft_consensus.cc:2781] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.405045 1682 raft_consensus.cc:374] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.405092 1682 raft_consensus.cc:729] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.404726 1680 ts_tablet_manager.cc:1398] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.405200 1685 raft_consensus.cc:686] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.405359 1685 consensus_queue.cc:237] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.405563 1680 tablet_bootstrap.cc:492] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.405052 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad66f33efc3e4033a129c6063b8845ba" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.406037 1562 raft_consensus.cc:3037] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.406394 1680 tablet_bootstrap.cc:654] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.406854 1562 raft_consensus.cc:2454] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.406817 1383 catalog_manager.cc:5484] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.403124 1689 leader_election.cc:288] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.405202 1682 consensus_queue.cc:260] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.407450 1682 ts_tablet_manager.cc:1398] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.407503 1680 tablet_bootstrap.cc:492] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.407575 1680 ts_tablet_manager.cc:1367] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.407596 1682 tablet_bootstrap.cc:492] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.407989 1681 tablet_bootstrap.cc:654] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.407940 1680 raft_consensus.cc:348] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.408042 1680 raft_consensus.cc:374] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.408071 1680 raft_consensus.cc:729] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.408207 1680 consensus_queue.cc:260] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.408372 1682 tablet_bootstrap.cc:654] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.408823 1680 ts_tablet_manager.cc:1398] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.408980 1680 tablet_bootstrap.cc:492] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.409796 1680 tablet_bootstrap.cc:654] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.410707 1681 tablet_bootstrap.cc:492] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.410794 1681 ts_tablet_manager.cc:1367] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20240503 08:01:25.411119 1710 raft_consensus.cc:482] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.411192 1710 raft_consensus.cc:504] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.411211 1681 raft_consensus.cc:348] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.411298 1681 raft_consensus.cc:374] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.411329 1681 raft_consensus.cc:729] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.411425 1681 consensus_queue.cc:260] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.411602 1680 tablet_bootstrap.cc:492] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.411660 1680 ts_tablet_manager.cc:1367] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.411718 1681 ts_tablet_manager.cc:1398] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.411868 1681 tablet_bootstrap.cc:492] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.412020 1680 raft_consensus.cc:348] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.412108 1680 raft_consensus.cc:374] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.412139 1680 raft_consensus.cc:729] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.412325 1680 consensus_queue.cc:260] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.412643 1710 leader_election.cc:288] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.412680 1681 tablet_bootstrap.cc:654] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.412849 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418513984d364a129eebf2a2f49626b1" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.412958 1488 raft_consensus.cc:2454] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.413050 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418513984d364a129eebf2a2f49626b1" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.413136 1562 raft_consensus.cc:2454] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.413342 1602 leader_election.cc:302] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.413547 1710 raft_consensus.cc:2781] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.413604 1710 raft_consensus.cc:482] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.413619 1682 tablet_bootstrap.cc:492] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.413637 1710 raft_consensus.cc:3037] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.413691 1682 ts_tablet_manager.cc:1367] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240503 08:01:25.414067 1682 raft_consensus.cc:348] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.414165 1682 raft_consensus.cc:374] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.414186 1682 raft_consensus.cc:729] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.414263 1682 consensus_queue.cc:260] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.414064 1680 ts_tablet_manager.cc:1398] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.414419 1710 raft_consensus.cc:504] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.414593 1680 tablet_bootstrap.cc:492] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.414752 1710 leader_election.cc:288] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.414433 1682 ts_tablet_manager.cc:1398] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.414948 1682 tablet_bootstrap.cc:492] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.415539 1680 tablet_bootstrap.cc:654] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.415649 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418513984d364a129eebf2a2f49626b1" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.415738 1488 raft_consensus.cc:3037] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.415809 1682 tablet_bootstrap.cc:654] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.416448 1681 tablet_bootstrap.cc:492] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.416502 1681 ts_tablet_manager.cc:1367] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.416560 1488 raft_consensus.cc:2454] T 418513984d364a129eebf2a2f49626b1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.416867 1604 leader_election.cc:302] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.416842 1681 raft_consensus.cc:348] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.416926 1681 raft_consensus.cc:374] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.416954 1681 raft_consensus.cc:729] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.416996 1710 raft_consensus.cc:2781] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.417054 1710 raft_consensus.cc:686] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.417071 1681 consensus_queue.cc:260] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.417155 1710 consensus_queue.cc:237] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.417305 1681 ts_tablet_manager.cc:1398] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.417440 1681 tablet_bootstrap.cc:492] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.418164 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418513984d364a129eebf2a2f49626b1" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.418234 1681 tablet_bootstrap.cc:654] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.418256 1562 raft_consensus.cc:3037] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.419044 1562 raft_consensus.cc:2454] T 418513984d364a129eebf2a2f49626b1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.419131 1681 tablet_bootstrap.cc:492] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.419199 1681 ts_tablet_manager.cc:1367] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.419538 1681 raft_consensus.cc:348] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.419628 1681 raft_consensus.cc:374] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.419656 1681 raft_consensus.cc:729] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.419740 1681 consensus_queue.cc:260] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.419708 1384 catalog_manager.cc:5484] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.419991 1681 ts_tablet_manager.cc:1398] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.420128 1681 tablet_bootstrap.cc:492] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.421120 1681 tablet_bootstrap.cc:654] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.421267 1680 tablet_bootstrap.cc:492] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.421355 1680 ts_tablet_manager.cc:1367] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240503 08:01:25.421741 1680 raft_consensus.cc:348] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.421829 1680 raft_consensus.cc:374] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.421859 1680 raft_consensus.cc:729] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.421968 1680 consensus_queue.cc:260] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.422210 1680 ts_tablet_manager.cc:1398] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.422466 1680 tablet_bootstrap.cc:492] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.422827 1682 tablet_bootstrap.cc:492] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.422919 1681 tablet_bootstrap.cc:492] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.422959 1682 ts_tablet_manager.cc:1367] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20240503 08:01:25.423017 1681 ts_tablet_manager.cc:1367] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.423331 1680 tablet_bootstrap.cc:654] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.423527 1681 raft_consensus.cc:348] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.423627 1681 raft_consensus.cc:374] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.423779 1681 raft_consensus.cc:729] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.423611 1682 raft_consensus.cc:348] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.423933 1682 raft_consensus.cc:374] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.424021 1682 raft_consensus.cc:729] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.424149 1682 consensus_queue.cc:260] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.424145 1681 consensus_queue.cc:260] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.424511 1681 ts_tablet_manager.cc:1398] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.424677 1682 ts_tablet_manager.cc:1398] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.424861 1682 tablet_bootstrap.cc:492] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.425127 1681 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.425690 1682 tablet_bootstrap.cc:654] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.425982 1681 tablet_bootstrap.cc:654] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.426724 1682 tablet_bootstrap.cc:492] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.426803 1682 ts_tablet_manager.cc:1367] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.427063 1680 tablet_bootstrap.cc:492] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.427141 1680 ts_tablet_manager.cc:1367] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:01:25.427204 1691 raft_consensus.cc:482] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.427274 1691 raft_consensus.cc:504] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.427565 1680 raft_consensus.cc:348] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.427645 1691 leader_election.cc:288] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.427878 1681 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.427664 1680 raft_consensus.cc:374] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.427950 1680 raft_consensus.cc:729] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.427954 1681 ts_tablet_manager.cc:1367] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.428025 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16cc735ddd4540ba9b3f9726c6a3e0a8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.428124 1638 raft_consensus.cc:2454] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.428309 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16cc735ddd4540ba9b3f9726c6a3e0a8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.428339 1681 raft_consensus.cc:348] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.428344 1682 raft_consensus.cc:348] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.428408 1488 raft_consensus.cc:2454] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.428431 1681 raft_consensus.cc:374] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.428449 1682 raft_consensus.cc:374] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.428465 1681 raft_consensus.cc:729] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.428479 1682 raft_consensus.cc:729] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.428548 1681 consensus_queue.cc:260] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.428617 1528 leader_election.cc:302] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.428071 1680 consensus_queue.cc:260] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.428755 1691 raft_consensus.cc:2781] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.428799 1691 raft_consensus.cc:482] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.428810 1681 ts_tablet_manager.cc:1398] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.428833 1691 raft_consensus.cc:3037] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.428903 1680 ts_tablet_manager.cc:1398] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.428877 1682 consensus_queue.cc:260] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.428951 1681 tablet_bootstrap.cc:492] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.429039 1680 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.429703 1691 raft_consensus.cc:504] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.429766 1680 tablet_bootstrap.cc:654] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.430034 1691 leader_election.cc:288] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.430294 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16cc735ddd4540ba9b3f9726c6a3e0a8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.430378 1682 ts_tablet_manager.cc:1398] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.430565 1682 tablet_bootstrap.cc:492] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.429766 1681 tablet_bootstrap.cc:654] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.430361 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16cc735ddd4540ba9b3f9726c6a3e0a8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.431226 1638 raft_consensus.cc:3037] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.431565 1682 tablet_bootstrap.cc:654] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.432009 1638 raft_consensus.cc:2454] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.432322 1528 leader_election.cc:302] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.432466 1691 raft_consensus.cc:2781] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.432543 1691 raft_consensus.cc:686] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.432607 1682 tablet_bootstrap.cc:492] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.432612 1680 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.432694 1682 ts_tablet_manager.cc:1367] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:01:25.432705 1680 ts_tablet_manager.cc:1367] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.432657 1691 consensus_queue.cc:237] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.432865 1681 tablet_bootstrap.cc:492] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.432929 1681 ts_tablet_manager.cc:1367] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.433071 1680 raft_consensus.cc:348] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.433099 1682 raft_consensus.cc:348] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.433156 1680 raft_consensus.cc:374] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.433187 1680 raft_consensus.cc:729] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.430383 1488 raft_consensus.cc:3037] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.433276 1681 raft_consensus.cc:348] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.433327 1680 consensus_queue.cc:260] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.433562 1680 ts_tablet_manager.cc:1398] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.433707 1680 tablet_bootstrap.cc:492] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.433182 1682 raft_consensus.cc:374] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.433768 1682 raft_consensus.cc:729] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.433902 1682 consensus_queue.cc:260] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.434068 1488 raft_consensus.cc:2454] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.434224 1383 catalog_manager.cc:5484] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.434722 1682 ts_tablet_manager.cc:1398] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:01:25.434877 1682 tablet_bootstrap.cc:492] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.435113 1680 tablet_bootstrap.cc:654] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.433364 1681 raft_consensus.cc:374] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.435655 1681 raft_consensus.cc:729] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.435720 1682 tablet_bootstrap.cc:654] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.435772 1681 consensus_queue.cc:260] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.436033 1681 ts_tablet_manager.cc:1398] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.436209 1681 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.436676 1682 tablet_bootstrap.cc:492] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.436749 1682 ts_tablet_manager.cc:1367] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.437135 1681 tablet_bootstrap.cc:654] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.437141 1682 raft_consensus.cc:348] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.437276 1682 raft_consensus.cc:374] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.437314 1682 raft_consensus.cc:729] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.437423 1682 consensus_queue.cc:260] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.437688 1682 ts_tablet_manager.cc:1398] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.437847 1682 tablet_bootstrap.cc:492] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.437848 1680 tablet_bootstrap.cc:492] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.437991 1680 ts_tablet_manager.cc:1367] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.438391 1680 raft_consensus.cc:348] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.438481 1680 raft_consensus.cc:374] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.438513 1680 raft_consensus.cc:729] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.438629 1682 tablet_bootstrap.cc:654] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.438602 1680 consensus_queue.cc:260] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.438889 1680 ts_tablet_manager.cc:1398] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.439061 1680 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.439674 1682 tablet_bootstrap.cc:492] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.439749 1682 ts_tablet_manager.cc:1367] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.439955 1680 tablet_bootstrap.cc:654] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.440137 1682 raft_consensus.cc:348] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.440230 1682 raft_consensus.cc:374] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.440260 1682 raft_consensus.cc:729] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.440352 1682 consensus_queue.cc:260] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.440603 1682 ts_tablet_manager.cc:1398] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.440622 1697 raft_consensus.cc:482] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.440688 1697 raft_consensus.cc:504] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.440753 1682 tablet_bootstrap.cc:492] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.441025 1697 leader_election.cc:288] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.441532 1682 tablet_bootstrap.cc:654] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.441816 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3f7b80c0144221b60aac076bb330bd" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.441918 1488 raft_consensus.cc:2454] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.442137 1604 leader_election.cc:302] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.442211 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3f7b80c0144221b60aac076bb330bd" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.442281 1697 raft_consensus.cc:2781] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.442319 1562 raft_consensus.cc:2454] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.442330 1697 raft_consensus.cc:482] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.442440 1697 raft_consensus.cc:3037] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.443184 1681 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.443203 1697 raft_consensus.cc:504] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.443267 1681 ts_tablet_manager.cc:1367] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.443511 1697 leader_election.cc:288] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.443643 1697 raft_consensus.cc:482] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.443708 1697 raft_consensus.cc:504] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.443784 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3f7b80c0144221b60aac076bb330bd" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.443886 1682 tablet_bootstrap.cc:492] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.443961 1682 ts_tablet_manager.cc:1367] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.443990 1697 leader_election.cc:288] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.444065 1681 raft_consensus.cc:348] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.444134 1746 raft_consensus.cc:482] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.444213 1746 raft_consensus.cc:504] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.444252 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c219ee9b1aaf4c75a0581d9ea9fcc907" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.444315 1682 raft_consensus.cc:348] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.444396 1682 raft_consensus.cc:374] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.444424 1682 raft_consensus.cc:729] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.444509 1746 leader_election.cc:288] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
W20240503 08:01:25.444547 1602 leader_election.cc:341] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.444145 1681 raft_consensus.cc:374] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.444675 1681 raft_consensus.cc:729] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.443863 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d3f7b80c0144221b60aac076bb330bd" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.444519 1682 consensus_queue.cc:260] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.444861 1488 raft_consensus.cc:3037] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.444919 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "589889a5006a4fccaa237697405fda28" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.445063 1682 ts_tablet_manager.cc:1398] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.444768 1681 consensus_queue.cc:260] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
W20240503 08:01:25.445178 1452 leader_election.cc:341] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.445245 1682 tablet_bootstrap.cc:492] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.445304 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "589889a5006a4fccaa237697405fda28" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.445338 1681 ts_tablet_manager.cc:1398] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.445382 1564 raft_consensus.cc:2454] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.445477 1681 tablet_bootstrap.cc:492] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.445662 1488 raft_consensus.cc:2454] T 3d3f7b80c0144221b60aac076bb330bd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.443877 1562 raft_consensus.cc:3037] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.446146 1451 leader_election.cc:302] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters: 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.446394 1689 raft_consensus.cc:2781] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.446441 1689 raft_consensus.cc:482] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.446475 1689 raft_consensus.cc:3037] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.446543 1562 raft_consensus.cc:2454] T 3d3f7b80c0144221b60aac076bb330bd P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.446600 1682 tablet_bootstrap.cc:654] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.446600 1681 tablet_bootstrap.cc:654] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.446766 1602 leader_election.cc:302] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.446992 1697 raft_consensus.cc:2781] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.447063 1697 raft_consensus.cc:686] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.447175 1697 consensus_queue.cc:237] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.447219 1689 raft_consensus.cc:504] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.447535 1710 raft_consensus.cc:482] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.447597 1710 raft_consensus.cc:504] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.447902 1710 leader_election.cc:288] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.448132 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a1ffb916e457aacb4f84dae69cb32" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.448225 1562 raft_consensus.cc:2454] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.448424 1602 leader_election.cc:302] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.448491 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "589889a5006a4fccaa237697405fda28" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.448580 1564 raft_consensus.cc:3037] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.448607 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c219ee9b1aaf4c75a0581d9ea9fcc907" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.448817 1686 raft_consensus.cc:482] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.448881 1686 raft_consensus.cc:504] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.449180 1686 leader_election.cc:288] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.449420 1689 leader_election.cc:288] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.449519 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a1ffb916e457aacb4f84dae69cb32" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.449622 1487 raft_consensus.cc:2454] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.449707 1384 catalog_manager.cc:5484] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.449420 1564 raft_consensus.cc:2454] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.450099 1680 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.450219 1680 ts_tablet_manager.cc:1367] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20240503 08:01:25.450414 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e77365e9a143fbb8d43e3fd0308ffb" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.450515 1639 raft_consensus.cc:2454] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.450673 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "589889a5006a4fccaa237697405fda28" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.450731 1680 raft_consensus.cc:348] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.450801 1680 raft_consensus.cc:374] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.450830 1680 raft_consensus.cc:729] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.450956 1680 consensus_queue.cc:260] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
W20240503 08:01:25.451077 1452 leader_election.cc:341] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.451171 1697 raft_consensus.cc:2781] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.451206 1697 raft_consensus.cc:482] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.451223 1680 ts_tablet_manager.cc:1398] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.451247 1697 raft_consensus.cc:3037] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.451365 1680 tablet_bootstrap.cc:492] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.452046 1697 raft_consensus.cc:504] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.452386 1697 leader_election.cc:288] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.452479 1680 tablet_bootstrap.cc:654] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.450987 1528 leader_election.cc:302] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.452800 1686 raft_consensus.cc:2781] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.452865 1686 raft_consensus.cc:482] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.452911 1686 raft_consensus.cc:3037] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.453478 1680 tablet_bootstrap.cc:492] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.453564 1680 ts_tablet_manager.cc:1367] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.453688 1686 raft_consensus.cc:504] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.454012 1686 leader_election.cc:288] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.454331 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e77365e9a143fbb8d43e3fd0308ffb" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.454428 1638 raft_consensus.cc:3037] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.454540 1681 tablet_bootstrap.cc:492] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.454604 1682 tablet_bootstrap.cc:492] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.454615 1681 ts_tablet_manager.cc:1367] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:01:25.454699 1682 ts_tablet_manager.cc:1367] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20240503 08:01:25.455003 1681 raft_consensus.cc:348] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.455031 1682 raft_consensus.cc:348] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.455096 1681 raft_consensus.cc:374] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.455103 1682 raft_consensus.cc:374] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.453975 1680 raft_consensus.cc:348] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.455153 1638 raft_consensus.cc:2454] T 76e77365e9a143fbb8d43e3fd0308ffb P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.455175 1680 raft_consensus.cc:374] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.455235 1680 raft_consensus.cc:729] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
W20240503 08:01:25.455336 1604 leader_election.cc:341] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.455353 1680 consensus_queue.cc:260] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.455493 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a1ffb916e457aacb4f84dae69cb32" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.455574 1487 raft_consensus.cc:3037] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.455639 1680 ts_tablet_manager.cc:1398] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.455789 1680 tablet_bootstrap.cc:492] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.455813 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a1ffb916e457aacb4f84dae69cb32" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.455901 1564 raft_consensus.cc:3037] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.456104 1451 leader_election.cc:302] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters: 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.456284 1689 raft_consensus.cc:2781] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.456347 1689 raft_consensus.cc:686] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.456375 1487 raft_consensus.cc:2454] T 293a1ffb916e457aacb4f84dae69cb32 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.456451 1689 consensus_queue.cc:237] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.456561 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e77365e9a143fbb8d43e3fd0308ffb" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.456612 1564 raft_consensus.cc:2454] T 293a1ffb916e457aacb4f84dae69cb32 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.456679 1680 tablet_bootstrap.cc:654] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.456693 1486 raft_consensus.cc:3037] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.457113 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76e77365e9a143fbb8d43e3fd0308ffb" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.455160 1682 raft_consensus.cc:729] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.455390 1528 leader_election.cc:302] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.457309 1682 consensus_queue.cc:260] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.457468 1686 raft_consensus.cc:2781] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.457523 1486 raft_consensus.cc:2454] T 76e77365e9a143fbb8d43e3fd0308ffb P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.455149 1681 raft_consensus.cc:729] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.457625 1686 raft_consensus.cc:686] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.457624 1682 ts_tablet_manager.cc:1398] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.457713 1681 consensus_queue.cc:260] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.457769 1686 consensus_queue.cc:237] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.457825 1682 tablet_bootstrap.cc:492] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.457962 1681 ts_tablet_manager.cc:1398] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.458106 1681 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.458427 1602 leader_election.cc:302] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.458683 1682 tablet_bootstrap.cc:654] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.459034 1681 tablet_bootstrap.cc:654] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.459120 1710 raft_consensus.cc:2781] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.459188 1710 raft_consensus.cc:686] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.459326 1710 consensus_queue.cc:237] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.455391 1604 leader_election.cc:302] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f870be2d05c49bbab11db8ad76d6c89; no voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.459753 1384 catalog_manager.cc:5484] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.459946 1697 raft_consensus.cc:2726] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.461036 1680 tablet_bootstrap.cc:492] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.461122 1680 ts_tablet_manager.cc:1367] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.461488 1680 raft_consensus.cc:348] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.461584 1680 raft_consensus.cc:374] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.461614 1680 raft_consensus.cc:729] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.461731 1680 consensus_queue.cc:260] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.462054 1680 ts_tablet_manager.cc:1398] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.462211 1680 tablet_bootstrap.cc:492] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.462678 1681 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.462766 1681 ts_tablet_manager.cc:1367] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240503 08:01:25.462719 1383 catalog_manager.cc:5484] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.463049 1680 tablet_bootstrap.cc:654] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.463152 1681 raft_consensus.cc:348] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.463240 1681 raft_consensus.cc:374] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.463268 1681 raft_consensus.cc:729] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.463361 1681 consensus_queue.cc:260] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.463620 1681 ts_tablet_manager.cc:1398] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.463770 1681 tablet_bootstrap.cc:492] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.463848 1384 catalog_manager.cc:5484] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.464534 1681 tablet_bootstrap.cc:654] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.465636 1682 tablet_bootstrap.cc:492] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.465718 1682 ts_tablet_manager.cc:1367] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240503 08:01:25.466073 1682 raft_consensus.cc:348] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.466154 1682 raft_consensus.cc:374] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.466187 1682 raft_consensus.cc:729] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.466302 1682 consensus_queue.cc:260] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.466521 1681 tablet_bootstrap.cc:492] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.466609 1681 ts_tablet_manager.cc:1367] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.466986 1681 raft_consensus.cc:348] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.467097 1681 raft_consensus.cc:374] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.467135 1681 raft_consensus.cc:729] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.467235 1681 consensus_queue.cc:260] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.466522 1682 ts_tablet_manager.cc:1398] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.467504 1681 ts_tablet_manager.cc:1398] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.467694 1681 tablet_bootstrap.cc:492] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.467851 1682 tablet_bootstrap.cc:492] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.468664 1681 tablet_bootstrap.cc:654] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.468840 1682 tablet_bootstrap.cc:654] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.469633 1681 tablet_bootstrap.cc:492] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.469746 1681 ts_tablet_manager.cc:1367] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.469763 1682 tablet_bootstrap.cc:492] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.469834 1682 ts_tablet_manager.cc:1367] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.470134 1681 raft_consensus.cc:348] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.470213 1681 raft_consensus.cc:374] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.470170 1682 raft_consensus.cc:348] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.470247 1681 raft_consensus.cc:729] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.470268 1682 raft_consensus.cc:374] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.470299 1682 raft_consensus.cc:729] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.470350 1681 consensus_queue.cc:260] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.470413 1682 consensus_queue.cc:260] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.470580 1681 ts_tablet_manager.cc:1398] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.470672 1682 ts_tablet_manager.cc:1398] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.470727 1681 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.470844 1682 tablet_bootstrap.cc:492] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.471674 1682 tablet_bootstrap.cc:654] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.472057 1681 tablet_bootstrap.cc:654] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.472707 1682 tablet_bootstrap.cc:492] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.472801 1682 ts_tablet_manager.cc:1367] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.473208 1682 raft_consensus.cc:348] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.473299 1682 raft_consensus.cc:374] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.473328 1682 raft_consensus.cc:729] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.473433 1682 consensus_queue.cc:260] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.473520 1680 tablet_bootstrap.cc:492] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.473618 1680 ts_tablet_manager.cc:1367] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20240503 08:01:25.473690 1682 ts_tablet_manager.cc:1398] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.473862 1682 tablet_bootstrap.cc:492] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.474009 1680 raft_consensus.cc:348] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.474107 1680 raft_consensus.cc:374] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.474143 1680 raft_consensus.cc:729] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.474241 1680 consensus_queue.cc:260] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.474481 1680 ts_tablet_manager.cc:1398] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.474627 1680 tablet_bootstrap.cc:492] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.474679 1682 tablet_bootstrap.cc:654] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.475212 1778 raft_consensus.cc:482] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.475301 1778 raft_consensus.cc:504] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.475399 1680 tablet_bootstrap.cc:654] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.475708 1778 leader_election.cc:288] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.475886 1682 tablet_bootstrap.cc:492] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.475955 1682 ts_tablet_manager.cc:1367] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.476220 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2936bd2bc39d4456a9886b2b10e9b4c0" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.476332 1682 raft_consensus.cc:348] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.476408 1682 raft_consensus.cc:374] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.476436 1682 raft_consensus.cc:729] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.476438 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2936bd2bc39d4456a9886b2b10e9b4c0" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
W20240503 08:01:25.476811 1528 leader_election.cc:341] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:01:25.476882 1529 leader_election.cc:341] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.476933 1529 leader_election.cc:302] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.477157 1686 raft_consensus.cc:2726] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.476532 1682 consensus_queue.cc:260] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.477557 1682 ts_tablet_manager.cc:1398] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.477803 1680 tablet_bootstrap.cc:492] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.477878 1680 ts_tablet_manager.cc:1367] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240503 08:01:25.477922 1682 tablet_bootstrap.cc:492] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.477936 1686 raft_consensus.cc:482] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.478101 1686 raft_consensus.cc:504] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.478245 1680 raft_consensus.cc:348] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.478312 1680 raft_consensus.cc:374] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.478330 1680 raft_consensus.cc:729] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.478399 1686 leader_election.cc:288] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.478418 1680 consensus_queue.cc:260] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.478646 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ebd7eb10c4aef85de0b17abcbf686" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.478677 1680 ts_tablet_manager.cc:1398] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.478879 1682 tablet_bootstrap.cc:654] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.478865 1680 tablet_bootstrap.cc:492] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.479130 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ebd7eb10c4aef85de0b17abcbf686" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
W20240503 08:01:25.479399 1529 leader_election.cc:341] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:01:25.479537 1528 leader_election.cc:341] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.479590 1528 leader_election.cc:302] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.479707 1686 raft_consensus.cc:2726] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.479813 1680 tablet_bootstrap.cc:654] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.480695 1681 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.480736 1680 tablet_bootstrap.cc:492] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.480785 1681 ts_tablet_manager.cc:1367] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20240503 08:01:25.480789 1680 ts_tablet_manager.cc:1367] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.481119 1680 raft_consensus.cc:348] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.481216 1680 raft_consensus.cc:374] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.481182 1681 raft_consensus.cc:348] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.481257 1680 raft_consensus.cc:729] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.481269 1681 raft_consensus.cc:374] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.481302 1681 raft_consensus.cc:729] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.481357 1680 consensus_queue.cc:260] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.481410 1681 consensus_queue.cc:260] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.481601 1680 ts_tablet_manager.cc:1398] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.481631 1681 ts_tablet_manager.cc:1398] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.481789 1681 tablet_bootstrap.cc:492] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.481809 1680 tablet_bootstrap.cc:492] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.482568 1681 tablet_bootstrap.cc:654] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.483457 1680 tablet_bootstrap.cc:654] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.483587 1772 raft_consensus.cc:482] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.483659 1772 raft_consensus.cc:504] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.484002 1772 leader_election.cc:288] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.484360 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c8c6ca18ca47d18e3650e09dac28cc" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.484483 1680 tablet_bootstrap.cc:492] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.484555 1680 ts_tablet_manager.cc:1367] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.484681 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c8c6ca18ca47d18e3650e09dac28cc" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.484772 1486 raft_consensus.cc:2454] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.484915 1680 raft_consensus.cc:348] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.484969 1604 leader_election.cc:302] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.484467 1564 raft_consensus.cc:2454] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.485206 1686 raft_consensus.cc:482] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.485278 1686 raft_consensus.cc:504] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.485549 1772 raft_consensus.cc:2781] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.485580 1686 leader_election.cc:288] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.485605 1772 raft_consensus.cc:482] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.485644 1772 raft_consensus.cc:3037] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.485913 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4576f5272c45089055f9f0d36db63c" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.486007 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4576f5272c45089055f9f0d36db63c" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.485000 1680 raft_consensus.cc:374] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.486137 1680 raft_consensus.cc:729] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
W20240503 08:01:25.486229 1529 leader_election.cc:341] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.486259 1680 consensus_queue.cc:260] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.486385 1638 raft_consensus.cc:2454] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.486508 1680 ts_tablet_manager.cc:1398] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.486582 1772 raft_consensus.cc:504] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.486653 1528 leader_election.cc:302] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.486662 1680 tablet_bootstrap.cc:492] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.486903 1772 leader_election.cc:288] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.487075 1686 raft_consensus.cc:2781] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.487128 1686 raft_consensus.cc:482] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.487167 1686 raft_consensus.cc:3037] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.487360 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c8c6ca18ca47d18e3650e09dac28cc" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.487493 1486 raft_consensus.cc:3037] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.487677 1680 tablet_bootstrap.cc:654] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.487972 1686 raft_consensus.cc:504] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.488292 1486 raft_consensus.cc:2454] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.488540 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4576f5272c45089055f9f0d36db63c" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.488548 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c8c6ca18ca47d18e3650e09dac28cc" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.488622 1604 leader_election.cc:302] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.488643 1638 raft_consensus.cc:3037] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.488699 1564 raft_consensus.cc:3037] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.488277 1686 leader_election.cc:288] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.488955 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4576f5272c45089055f9f0d36db63c" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.489135 1772 raft_consensus.cc:2781] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.489203 1772 raft_consensus.cc:686] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.489326 1772 consensus_queue.cc:237] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.489437 1564 raft_consensus.cc:2454] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
W20240503 08:01:25.489511 1529 leader_election.cc:341] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.489447 1638 raft_consensus.cc:2454] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.488592 1680 tablet_bootstrap.cc:492] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.489826 1680 ts_tablet_manager.cc:1367] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.489809 1528 leader_election.cc:302] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.490159 1686 raft_consensus.cc:2781] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.490167 1680 raft_consensus.cc:348] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.490252 1686 raft_consensus.cc:686] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.490268 1680 raft_consensus.cc:374] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.490332 1680 raft_consensus.cc:729] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.490360 1686 consensus_queue.cc:237] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.490447 1680 consensus_queue.cc:260] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.490703 1680 ts_tablet_manager.cc:1398] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.490846 1680 tablet_bootstrap.cc:492] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.491809 1680 tablet_bootstrap.cc:654] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.491947 1681 tablet_bootstrap.cc:492] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.492030 1681 ts_tablet_manager.cc:1367] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20240503 08:01:25.492106 1385 catalog_manager.cc:5484] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.492394 1681 raft_consensus.cc:348] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.492487 1681 raft_consensus.cc:374] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.492525 1681 raft_consensus.cc:729] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.492630 1681 consensus_queue.cc:260] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.492861 1680 tablet_bootstrap.cc:492] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.492952 1680 ts_tablet_manager.cc:1367] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.493191 1681 ts_tablet_manager.cc:1398] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.493357 1681 tablet_bootstrap.cc:492] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.493317 1680 raft_consensus.cc:348] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.493430 1680 raft_consensus.cc:374] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.493461 1680 raft_consensus.cc:729] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.493553 1680 consensus_queue.cc:260] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.493808 1680 ts_tablet_manager.cc:1398] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.493963 1680 tablet_bootstrap.cc:492] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.492092 1384 catalog_manager.cc:5484] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.494181 1681 tablet_bootstrap.cc:654] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.494868 1680 tablet_bootstrap.cc:654] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.495136 1682 tablet_bootstrap.cc:492] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.495213 1682 ts_tablet_manager.cc:1367] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20240503 08:01:25.495628 1682 raft_consensus.cc:348] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.495723 1682 raft_consensus.cc:374] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.495757 1682 raft_consensus.cc:729] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.495855 1682 consensus_queue.cc:260] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.495965 1772 raft_consensus.cc:482] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.496044 1772 raft_consensus.cc:504] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.496110 1682 ts_tablet_manager.cc:1398] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.496343 1772 leader_election.cc:288] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.496392 1682 tablet_bootstrap.cc:492] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.496784 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243ebc6725bc47faadf3e3a1c32a6859" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.496888 1564 raft_consensus.cc:2454] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.497130 1602 leader_election.cc:302] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.497205 1682 tablet_bootstrap.cc:654] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.497239 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243ebc6725bc47faadf3e3a1c32a6859" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.497277 1710 raft_consensus.cc:2781] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.497316 1710 raft_consensus.cc:482] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.497339 1486 raft_consensus.cc:2454] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.497352 1710 raft_consensus.cc:3037] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.504179 1772 raft_consensus.cc:482] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.504254 1772 raft_consensus.cc:504] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.504528 1772 leader_election.cc:288] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.504629 1772 raft_consensus.cc:482] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.504685 1772 raft_consensus.cc:504] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.504787 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2936bd2bc39d4456a9886b2b10e9b4c0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.504787 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2936bd2bc39d4456a9886b2b10e9b4c0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.504945 1564 raft_consensus.cc:2454] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.504974 1772 leader_election.cc:288] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.505158 1602 leader_election.cc:302] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.505271 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52a1a85e18542c1b66458a67a9f79b7" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.505259 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52a1a85e18542c1b66458a67a9f79b7" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
W20240503 08:01:25.505286 1604 leader_election.cc:341] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.505344 1772 raft_consensus.cc:2781] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.505406 1486 raft_consensus.cc:2454] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.505431 1772 raft_consensus.cc:482] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.505447 1564 raft_consensus.cc:2454] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.505468 1772 raft_consensus.cc:3037] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.505625 1604 leader_election.cc:302] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.505766 1697 raft_consensus.cc:2781] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.505815 1697 raft_consensus.cc:482] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.505839 1697 raft_consensus.cc:3037] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.507011 1802 raft_consensus.cc:482] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.507072 1802 raft_consensus.cc:504] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.507472 1802 leader_election.cc:288] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.507577 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "970a0c99cf944e55b89833ebb22db26b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.507686 1564 raft_consensus.cc:2454] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.507688 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "970a0c99cf944e55b89833ebb22db26b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.507829 1486 raft_consensus.cc:2454] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.507906 1602 leader_election.cc:302] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.508056 1802 raft_consensus.cc:2781] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.508102 1802 raft_consensus.cc:482] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.508139 1802 raft_consensus.cc:3037] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.512356 1681 tablet_bootstrap.cc:492] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.512360 1772 raft_consensus.cc:504] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.512413 1710 raft_consensus.cc:504] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.512482 1681 ts_tablet_manager.cc:1367] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.001s
I20240503 08:01:25.512522 1697 raft_consensus.cc:504] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.512682 1710 leader_election.cc:288] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.512809 1697 leader_election.cc:288] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.512861 1778 raft_consensus.cc:482] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.512931 1778 raft_consensus.cc:504] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.513072 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2936bd2bc39d4456a9886b2b10e9b4c0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.513185 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243ebc6725bc47faadf3e3a1c32a6859" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.513267 1488 raft_consensus.cc:3037] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
W20240503 08:01:25.513427 1604 leader_election.cc:341] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.513571 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2936bd2bc39d4456a9886b2b10e9b4c0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.512935 1681 raft_consensus.cc:348] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.513573 1680 tablet_bootstrap.cc:492] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.513696 1681 raft_consensus.cc:374] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.513738 1681 raft_consensus.cc:729] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.513653 1562 raft_consensus.cc:3037] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.513760 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a79a5bc33441e0954896919f0e9da8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.513849 1638 raft_consensus.cc:2454] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.513700 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52a1a85e18542c1b66458a67a9f79b7" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.514122 1488 raft_consensus.cc:2454] T 243ebc6725bc47faadf3e3a1c32a6859 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.514144 1563 raft_consensus.cc:3037] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.513234 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52a1a85e18542c1b66458a67a9f79b7" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.514314 1682 tablet_bootstrap.cc:492] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.514369 1487 raft_consensus.cc:3037] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.512682 1772 leader_election.cc:288] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.514489 1562 raft_consensus.cc:2454] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.513235 1778 leader_election.cc:288] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.514633 1528 leader_election.cc:302] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.514847 1778 raft_consensus.cc:2781] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.514897 1778 raft_consensus.cc:482] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.514951 1778 raft_consensus.cc:3037] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.515048 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243ebc6725bc47faadf3e3a1c32a6859" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.515126 1564 raft_consensus.cc:3037] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.515184 1487 raft_consensus.cc:2454] T c52a1a85e18542c1b66458a67a9f79b7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.515362 1602 leader_election.cc:302] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.514954 1563 raft_consensus.cc:2454] T c52a1a85e18542c1b66458a67a9f79b7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.515525 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a79a5bc33441e0954896919f0e9da8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.515568 1697 raft_consensus.cc:2781] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.515619 1488 raft_consensus.cc:2454] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.515635 1697 raft_consensus.cc:686] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.513760 1680 ts_tablet_manager.cc:1367] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.002s
I20240503 08:01:25.515749 1697 consensus_queue.cc:237] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.515798 1778 raft_consensus.cc:504] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.515192 1772 raft_consensus.cc:482] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.515985 1772 raft_consensus.cc:504] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.516119 1680 raft_consensus.cc:348] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.516224 1680 raft_consensus.cc:374] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.516258 1680 raft_consensus.cc:729] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.516358 1604 leader_election.cc:302] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.516225 1772 leader_election.cc:288] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.516498 1604 leader_election.cc:302] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.516543 1772 raft_consensus.cc:2781] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.516579 1564 raft_consensus.cc:2454] T 243ebc6725bc47faadf3e3a1c32a6859 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.516597 1772 raft_consensus.cc:686] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.516719 1772 consensus_queue.cc:237] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.516758 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "793b3b6ea5a84982beaf5207f13f8e0b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.513850 1681 consensus_queue.cc:260] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.516861 1488 raft_consensus.cc:2454] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.517091 1681 ts_tablet_manager.cc:1398] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.514389 1682 ts_tablet_manager.cc:1367] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20240503 08:01:25.517256 1772 raft_consensus.cc:2781] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.517324 1772 raft_consensus.cc:686] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.516120 1778 leader_election.cc:288] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.517426 1772 consensus_queue.cc:237] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.517568 1682 raft_consensus.cc:348] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.517657 1682 raft_consensus.cc:374] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.517688 1682 raft_consensus.cc:729] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.517746 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a79a5bc33441e0954896919f0e9da8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.517819 1638 raft_consensus.cc:3037] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.517802 1682 consensus_queue.cc:260] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.518055 1682 ts_tablet_manager.cc:1398] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.518221 1682 tablet_bootstrap.cc:492] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.516356 1680 consensus_queue.cc:260] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.518800 1680 ts_tablet_manager.cc:1398] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240503 08:01:25.518944 1680 tablet_bootstrap.cc:492] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.519073 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "793b3b6ea5a84982beaf5207f13f8e0b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.519169 1564 raft_consensus.cc:2454] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.519196 1682 tablet_bootstrap.cc:654] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.519394 1602 leader_election.cc:302] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.518529 1638 raft_consensus.cc:2454] T 07a79a5bc33441e0954896919f0e9da8 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.519750 1528 leader_election.cc:302] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.519838 1680 tablet_bootstrap.cc:654] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.519886 1778 raft_consensus.cc:2781] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.519941 1778 raft_consensus.cc:686] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.520053 1778 consensus_queue.cc:237] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.517274 1681 tablet_bootstrap.cc:492] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.520258 1689 raft_consensus.cc:482] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.520442 1689 raft_consensus.cc:504] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.520754 1689 leader_election.cc:288] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.521006 1802 raft_consensus.cc:504] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.521354 1802 leader_election.cc:288] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.521533 1681 tablet_bootstrap.cc:654] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.521797 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "970a0c99cf944e55b89833ebb22db26b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.521883 1564 raft_consensus.cc:3037] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.521534 1802 raft_consensus.cc:2781] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.522112 1802 raft_consensus.cc:482] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.522150 1802 raft_consensus.cc:3037] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.522593 1564 raft_consensus.cc:2454] T 970a0c99cf944e55b89833ebb22db26b P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.522830 1802 raft_consensus.cc:504] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.522964 1602 leader_election.cc:302] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.523172 1710 raft_consensus.cc:2781] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.523216 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a79a5bc33441e0954896919f0e9da8" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.523242 1710 raft_consensus.cc:686] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.523296 1488 raft_consensus.cc:3037] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.523267 1384 catalog_manager.cc:5484] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.523368 1802 leader_election.cc:288] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.523350 1710 consensus_queue.cc:237] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.523355 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "793b3b6ea5a84982beaf5207f13f8e0b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.524081 1488 raft_consensus.cc:2454] T 07a79a5bc33441e0954896919f0e9da8 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.524096 1564 raft_consensus.cc:3037] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.524380 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c81a3f38a34cba88f04bc01c734427" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.524489 1563 raft_consensus.cc:2454] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.524659 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c81a3f38a34cba88f04bc01c734427" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.524765 1638 raft_consensus.cc:2454] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.525084 1452 leader_election.cc:302] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.525161 1564 raft_consensus.cc:2454] T 793b3b6ea5a84982beaf5207f13f8e0b P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.525219 1689 raft_consensus.cc:2781] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.525275 1689 raft_consensus.cc:482] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.525321 1689 raft_consensus.cc:3037] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.525413 1602 leader_election.cc:302] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.525552 1710 raft_consensus.cc:2781] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.525621 1710 raft_consensus.cc:686] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.525730 1710 consensus_queue.cc:237] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.526047 1680 tablet_bootstrap.cc:492] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.526131 1680 ts_tablet_manager.cc:1367] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20240503 08:01:25.526096 1689 raft_consensus.cc:504] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.526379 1689 leader_election.cc:288] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.526522 1680 raft_consensus.cc:348] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.526479 1385 catalog_manager.cc:5484] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.526607 1680 raft_consensus.cc:374] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.526636 1680 raft_consensus.cc:729] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.526732 1680 consensus_queue.cc:260] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.526904 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c81a3f38a34cba88f04bc01c734427" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.526981 1638 raft_consensus.cc:3037] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.527043 1680 ts_tablet_manager.cc:1398] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.527109 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "793b3b6ea5a84982beaf5207f13f8e0b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.527204 1487 raft_consensus.cc:3037] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.527194 1680 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.527627 1681 tablet_bootstrap.cc:492] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.527700 1681 ts_tablet_manager.cc:1367] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240503 08:01:25.527740 1638 raft_consensus.cc:2454] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.527969 1487 raft_consensus.cc:2454] T 793b3b6ea5a84982beaf5207f13f8e0b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.528075 1681 raft_consensus.cc:348] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.528174 1681 raft_consensus.cc:374] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.528205 1681 raft_consensus.cc:729] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.528311 1681 consensus_queue.cc:260] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.527189 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "970a0c99cf944e55b89833ebb22db26b" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.528436 1488 raft_consensus.cc:3037] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.528568 1681 ts_tablet_manager.cc:1398] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.528594 1452 leader_election.cc:302] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.528719 1681 tablet_bootstrap.cc:492] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.528772 1746 raft_consensus.cc:2781] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.528839 1746 raft_consensus.cc:686] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.528942 1746 consensus_queue.cc:237] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.529198 1488 raft_consensus.cc:2454] T 970a0c99cf944e55b89833ebb22db26b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.528208 1680 tablet_bootstrap.cc:654] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.529567 1681 tablet_bootstrap.cc:654] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.529853 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6c81a3f38a34cba88f04bc01c734427" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.529948 1564 raft_consensus.cc:3037] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.530335 1682 tablet_bootstrap.cc:492] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.530405 1682 ts_tablet_manager.cc:1367] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240503 08:01:25.530637 1564 raft_consensus.cc:2454] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.530799 1682 raft_consensus.cc:348] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.530889 1682 raft_consensus.cc:374] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.530920 1682 raft_consensus.cc:729] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.531000 1686 raft_consensus.cc:482] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.531018 1682 consensus_queue.cc:260] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.531067 1686 raft_consensus.cc:504] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.531070 1383 catalog_manager.cc:5484] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.531265 1682 ts_tablet_manager.cc:1398] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.531219 1385 catalog_manager.cc:5484] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.531363 1686 leader_election.cc:288] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.531409 1682 tablet_bootstrap.cc:492] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.532181 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bd5a282529408ebde35305325417ce" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.532375 1681 tablet_bootstrap.cc:492] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.532403 1778 raft_consensus.cc:482] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.532454 1681 ts_tablet_manager.cc:1367] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.532469 1778 raft_consensus.cc:504] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.532788 1778 leader_election.cc:288] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.532852 1681 raft_consensus.cc:348] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.532944 1681 raft_consensus.cc:374] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.532976 1681 raft_consensus.cc:729] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.533072 1681 consensus_queue.cc:260] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.533126 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea8e975a53347df9e925173aeebaf61" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
W20240503 08:01:25.533179 1529 leader_election.cc:341] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.533221 1639 raft_consensus.cc:2454] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.533241 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bd5a282529408ebde35305325417ce" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.533318 1681 ts_tablet_manager.cc:1398] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.533455 1681 tablet_bootstrap.cc:492] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.531412 1385 catalog_manager.cc:5484] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.533603 1385 catalog_manager.cc:5484] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.532384 1682 tablet_bootstrap.cc:654] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.534477 1681 tablet_bootstrap.cc:654] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.534689 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea8e975a53347df9e925173aeebaf61" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.534780 1682 tablet_bootstrap.cc:492] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.534848 1682 ts_tablet_manager.cc:1367] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:01:25.533807 1385 catalog_manager.cc:5484] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.535035 1685 raft_consensus.cc:482] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.535115 1685 raft_consensus.cc:504] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
W20240503 08:01:25.535017 1529 leader_election.cc:341] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.535223 1682 raft_consensus.cc:348] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.535310 1682 raft_consensus.cc:374] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.535339 1682 raft_consensus.cc:729] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.535409 1685 leader_election.cc:288] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.535470 1682 consensus_queue.cc:260] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.535637 1528 leader_election.cc:302] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.535745 1682 ts_tablet_manager.cc:1398] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20240503 08:01:25.535831 1528 leader_election.cc:341] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.535893 1528 leader_election.cc:302] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.535910 1682 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.536123 1691 raft_consensus.cc:2781] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.536175 1691 raft_consensus.cc:482] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.536211 1691 raft_consensus.cc:3037] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.536396 1680 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.536461 1680 ts_tablet_manager.cc:1367] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240503 08:01:25.536749 1682 tablet_bootstrap.cc:654] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.536849 1680 raft_consensus.cc:348] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.536932 1680 raft_consensus.cc:374] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.536959 1680 raft_consensus.cc:729] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.537058 1691 raft_consensus.cc:504] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.537438 1686 raft_consensus.cc:2726] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.537498 1691 leader_election.cc:288] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.537876 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8545dc5db5dd48fea2116afe19dd17c1" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.538030 1638 raft_consensus.cc:2454] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.537940 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea8e975a53347df9e925173aeebaf61" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.537940 1682 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.538209 1682 ts_tablet_manager.cc:1367] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.538224 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea8e975a53347df9e925173aeebaf61" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.538306 1639 raft_consensus.cc:3037] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.538347 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8545dc5db5dd48fea2116afe19dd17c1" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.538420 1564 raft_consensus.cc:2454] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.537070 1680 consensus_queue.cc:260] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.538607 1682 raft_consensus.cc:348] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.538695 1682 raft_consensus.cc:374] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.538725 1682 raft_consensus.cc:729] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.538772 1680 ts_tablet_manager.cc:1398] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.538933 1680 tablet_bootstrap.cc:492] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.538829 1682 consensus_queue.cc:260] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.539635 1682 ts_tablet_manager.cc:1398] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.539827 1682 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.540235 1680 tablet_bootstrap.cc:654] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.540491 1681 tablet_bootstrap.cc:492] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.540575 1681 ts_tablet_manager.cc:1367] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.540692 1682 tablet_bootstrap.cc:654] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.539147 1639 raft_consensus.cc:2454] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
W20240503 08:01:25.538312 1529 leader_election.cc:341] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.539197 1452 leader_election.cc:302] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.540949 1681 raft_consensus.cc:348] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.541365 1528 leader_election.cc:302] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.541401 1681 raft_consensus.cc:374] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.541456 1681 raft_consensus.cc:729] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.541553 1681 consensus_queue.cc:260] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.541715 1691 raft_consensus.cc:2781] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.541800 1691 raft_consensus.cc:686] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.541826 1681 ts_tablet_manager.cc:1398] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.541932 1691 consensus_queue.cc:237] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.541994 1681 tablet_bootstrap.cc:492] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.542178 1685 raft_consensus.cc:2781] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.542233 1685 raft_consensus.cc:482] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.542271 1685 raft_consensus.cc:3037] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.542877 1681 tablet_bootstrap.cc:654] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.543074 1680 tablet_bootstrap.cc:492] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.543148 1680 ts_tablet_manager.cc:1367] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.543123 1685 raft_consensus.cc:504] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.543467 1685 leader_election.cc:288] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.543561 1680 raft_consensus.cc:348] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.543660 1680 raft_consensus.cc:374] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.543695 1680 raft_consensus.cc:729] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.543800 1680 consensus_queue.cc:260] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.543807 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8545dc5db5dd48fea2116afe19dd17c1" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.543992 1639 raft_consensus.cc:3037] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.544061 1680 ts_tablet_manager.cc:1398] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.544221 1680 tablet_bootstrap.cc:492] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.544205 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8545dc5db5dd48fea2116afe19dd17c1" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.544286 1564 raft_consensus.cc:3037] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.544745 1639 raft_consensus.cc:2454] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.544996 1564 raft_consensus.cc:2454] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.545024 1452 leader_election.cc:302] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.545153 1746 raft_consensus.cc:482] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.545253 1680 tablet_bootstrap.cc:654] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.545229 1746 raft_consensus.cc:504] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.545534 1746 leader_election.cc:288] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.545573 1682 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.545616 1746 raft_consensus.cc:2781] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.545635 1682 ts_tablet_manager.cc:1367] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240503 08:01:25.545677 1746 raft_consensus.cc:686] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.545792 1746 consensus_queue.cc:237] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.546011 1682 raft_consensus.cc:348] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.546095 1682 raft_consensus.cc:374] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.546125 1682 raft_consensus.cc:729] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.546217 1682 consensus_queue.cc:260] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.546458 1682 ts_tablet_manager.cc:1398] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.546499 1680 tablet_bootstrap.cc:492] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.546569 1680 ts_tablet_manager.cc:1367] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.546599 1682 tablet_bootstrap.cc:492] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.546926 1680 raft_consensus.cc:348] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.547024 1680 raft_consensus.cc:374] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.547055 1680 raft_consensus.cc:729] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.547147 1680 consensus_queue.cc:260] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.547407 1680 ts_tablet_manager.cc:1398] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.547470 1682 tablet_bootstrap.cc:654] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.547605 1680 tablet_bootstrap.cc:492] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.548439 1680 tablet_bootstrap.cc:654] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.548702 1384 catalog_manager.cc:5484] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.548830 1681 tablet_bootstrap.cc:492] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.548955 1681 ts_tablet_manager.cc:1367] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.549407 1681 raft_consensus.cc:348] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.549496 1681 raft_consensus.cc:374] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.549527 1681 raft_consensus.cc:729] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.549618 1681 consensus_queue.cc:260] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.549868 1681 ts_tablet_manager.cc:1398] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.550019 1681 tablet_bootstrap.cc:492] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.550575 1680 tablet_bootstrap.cc:492] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.550649 1680 ts_tablet_manager.cc:1367] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.550818 1681 tablet_bootstrap.cc:654] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.551028 1680 raft_consensus.cc:348] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.551121 1680 raft_consensus.cc:374] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.551152 1680 raft_consensus.cc:729] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.551245 1680 consensus_queue.cc:260] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.551525 1680 ts_tablet_manager.cc:1398] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.551681 1680 tablet_bootstrap.cc:492] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.551898 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ebd7eb10c4aef85de0b17abcbf686" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.551993 1564 raft_consensus.cc:2454] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.552151 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ebd7eb10c4aef85de0b17abcbf686" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.552243 1639 raft_consensus.cc:2454] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.552491 1452 leader_election.cc:302] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.552599 1680 tablet_bootstrap.cc:654] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.552634 1689 raft_consensus.cc:2781] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.552678 1689 raft_consensus.cc:482] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.552711 1689 raft_consensus.cc:3037] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.552762 1385 catalog_manager.cc:5484] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.553599 1682 tablet_bootstrap.cc:492] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.553685 1682 ts_tablet_manager.cc:1367] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.554077 1682 raft_consensus.cc:348] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.554175 1682 raft_consensus.cc:374] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.554205 1682 raft_consensus.cc:729] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.554328 1682 consensus_queue.cc:260] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.554486 1681 tablet_bootstrap.cc:492] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.554555 1681 ts_tablet_manager.cc:1367] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240503 08:01:25.554960 1681 raft_consensus.cc:348] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.555055 1681 raft_consensus.cc:374] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.555084 1681 raft_consensus.cc:729] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.555094 1682 ts_tablet_manager.cc:1398] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.555172 1681 consensus_queue.cc:260] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.555244 1682 tablet_bootstrap.cc:492] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.553557 1689 raft_consensus.cc:504] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.555413 1681 ts_tablet_manager.cc:1398] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.555579 1681 tablet_bootstrap.cc:492] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.555711 1689 leader_election.cc:288] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.556103 1682 tablet_bootstrap.cc:654] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.556175 1772 raft_consensus.cc:482] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.556257 1772 raft_consensus.cc:504] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.556448 1681 tablet_bootstrap.cc:654] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.556568 1772 leader_election.cc:288] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.556921 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2276ca9aefd240dca8eb751b715b6665" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.557035 1563 raft_consensus.cc:2454] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.557088 1686 raft_consensus.cc:482] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.556113 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ebd7eb10c4aef85de0b17abcbf686" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.557238 1564 raft_consensus.cc:3037] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.557651 1680 tablet_bootstrap.cc:492] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.557736 1680 ts_tablet_manager.cc:1367] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240503 08:01:25.557776 1682 tablet_bootstrap.cc:492] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.557848 1682 ts_tablet_manager.cc:1367] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.557894 1681 tablet_bootstrap.cc:492] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.557955 1681 ts_tablet_manager.cc:1367] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:01:25.558043 1564 raft_consensus.cc:2454] T 966ebd7eb10c4aef85de0b17abcbf686 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.558138 1680 raft_consensus.cc:348] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.558218 1680 raft_consensus.cc:374] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.558246 1680 raft_consensus.cc:729] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.558229 1682 raft_consensus.cc:348] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.558274 1681 raft_consensus.cc:348] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.558293 1451 leader_election.cc:302] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.558319 1682 raft_consensus.cc:374] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.558341 1681 raft_consensus.cc:374] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.558354 1682 raft_consensus.cc:729] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.558401 1681 raft_consensus.cc:729] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.558432 1689 raft_consensus.cc:2781] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.558467 1682 consensus_queue.cc:260] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.558498 1681 consensus_queue.cc:260] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.558656 1602 leader_election.cc:302] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.558733 1682 ts_tablet_manager.cc:1398] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.558796 1772 raft_consensus.cc:2781] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.557154 1686 raft_consensus.cc:504] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.558841 1772 raft_consensus.cc:482] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.558876 1772 raft_consensus.cc:3037] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.558897 1682 tablet_bootstrap.cc:492] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.559079 1686 leader_election.cc:288] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.559202 1686 raft_consensus.cc:482] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.559263 1686 raft_consensus.cc:504] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.559561 1686 leader_election.cc:288] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.559734 1772 raft_consensus.cc:504] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.559887 1682 tablet_bootstrap.cc:654] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.558347 1680 consensus_queue.cc:260] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.560053 1772 leader_election.cc:288] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.560235 1680 ts_tablet_manager.cc:1398] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.558501 1689 raft_consensus.cc:686] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.558740 1681 ts_tablet_manager.cc:1398] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.560420 1689 consensus_queue.cc:237] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.560495 1680 tablet_bootstrap.cc:492] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.560609 1681 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.561354 1680 tablet_bootstrap.cc:654] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.561385 1681 tablet_bootstrap.cc:654] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.561448 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd482dfb6e04b6f8d40ddd3a9f03367" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.561329 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2276ca9aefd240dca8eb751b715b6665" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.561902 1488 raft_consensus.cc:2454] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
W20240503 08:01:25.561774 1529 leader_election.cc:341] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.562425 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2276ca9aefd240dca8eb751b715b6665" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.562534 1638 raft_consensus.cc:2379] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 171fd27a77964e6588327f262ecffc39 in current term 1: Already voted for candidate 9f870be2d05c49bbab11db8ad76d6c89 in this term.
I20240503 08:01:25.562306 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "966ebd7eb10c4aef85de0b17abcbf686" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.562677 1639 raft_consensus.cc:3037] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.562716 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd482dfb6e04b6f8d40ddd3a9f03367" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.562919 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2276ca9aefd240dca8eb751b715b6665" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.563015 1487 raft_consensus.cc:2454] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.563030 1680 tablet_bootstrap.cc:492] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.563103 1680 ts_tablet_manager.cc:1367] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.563165 1681 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.563243 1681 ts_tablet_manager.cc:1367] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:01:25.563519 1680 raft_consensus.cc:348] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.563555 1639 raft_consensus.cc:2454] T 966ebd7eb10c4aef85de0b17abcbf686 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.563607 1680 raft_consensus.cc:374] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.563642 1680 raft_consensus.cc:729] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.563622 1681 raft_consensus.cc:348] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.563694 1681 raft_consensus.cc:374] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.563733 1681 raft_consensus.cc:729] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.563753 1680 consensus_queue.cc:260] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.563817 1681 consensus_queue.cc:260] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.563557 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2276ca9aefd240dca8eb751b715b6665" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.563999 1564 raft_consensus.cc:3037] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.564020 1680 ts_tablet_manager.cc:1398] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.564047 1681 ts_tablet_manager.cc:1398] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.564167 1681 tablet_bootstrap.cc:492] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.564167 1680 tablet_bootstrap.cc:492] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.564774 1564 raft_consensus.cc:2454] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.565039 1680 tablet_bootstrap.cc:654] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.565099 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2276ca9aefd240dca8eb751b715b6665" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.565157 1681 tablet_bootstrap.cc:654] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.565136 1682 tablet_bootstrap.cc:492] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.565196 1487 raft_consensus.cc:3037] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.565248 1682 ts_tablet_manager.cc:1367] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240503 08:01:25.565609 1682 raft_consensus.cc:348] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.565690 1682 raft_consensus.cc:374] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.565729 1682 raft_consensus.cc:729] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.563228 1529 leader_election.cc:302] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.565826 1682 consensus_queue.cc:260] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.565919 1778 raft_consensus.cc:2741] T 2276ca9aefd240dca8eb751b715b6665 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20240503 08:01:25.566023 1778 raft_consensus.cc:482] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.566066 1680 tablet_bootstrap.cc:492] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.566077 1682 ts_tablet_manager.cc:1398] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.566125 1680 ts_tablet_manager.cc:1367] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.566084 1778 raft_consensus.cc:504] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.566241 1682 tablet_bootstrap.cc:492] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.566454 1778 leader_election.cc:288] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.566511 1680 raft_consensus.cc:348] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.566598 1680 raft_consensus.cc:374] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.566630 1680 raft_consensus.cc:729] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
W20240503 08:01:25.566690 1528 leader_election.cc:341] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.566740 1528 leader_election.cc:302] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.566730 1680 consensus_queue.cc:260] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.566803 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3127e54a030482ab724e240c2b00c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.566967 1680 ts_tablet_manager.cc:1398] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.567113 1680 tablet_bootstrap.cc:492] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
W20240503 08:01:25.567087 1529 leader_election.cc:341] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.567130 1686 raft_consensus.cc:2726] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.567087 1682 tablet_bootstrap.cc:654] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.567171 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3127e54a030482ab724e240c2b00c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.567253 1639 raft_consensus.cc:2454] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.567481 1697 raft_consensus.cc:482] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.567548 1697 raft_consensus.cc:504] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.567827 1697 leader_election.cc:288] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.566938 1602 leader_election.cc:302] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.568260 1680 tablet_bootstrap.cc:654] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.568298 1697 raft_consensus.cc:2781] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.568392 1697 raft_consensus.cc:686] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.568507 1697 consensus_queue.cc:237] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.568909 1681 tablet_bootstrap.cc:492] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.568980 1681 ts_tablet_manager.cc:1367] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.569327 1680 tablet_bootstrap.cc:492] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.569296 1681 raft_consensus.cc:348] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.569415 1680 ts_tablet_manager.cc:1367] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.569423 1681 raft_consensus.cc:374] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.569530 1681 raft_consensus.cc:729] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.569618 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a89ecf63c0a4ebba117030ea7c82610" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.569638 1681 consensus_queue.cc:260] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.569703 1488 raft_consensus.cc:2454] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.569890 1681 ts_tablet_manager.cc:1398] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.569888 1680 raft_consensus.cc:348] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.570020 1680 raft_consensus.cc:374] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.570035 1604 leader_election.cc:302] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.570050 1680 raft_consensus.cc:729] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.570076 1681 tablet_bootstrap.cc:492] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.570205 1680 consensus_queue.cc:260] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.570333 1697 raft_consensus.cc:2781] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.570365 1697 raft_consensus.cc:482] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.570395 1697 raft_consensus.cc:3037] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.570732 1528 leader_election.cc:302] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.570874 1681 tablet_bootstrap.cc:654] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.570956 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a89ecf63c0a4ebba117030ea7c82610" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.571043 1564 raft_consensus.cc:2454] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.571192 1697 raft_consensus.cc:504] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.568200 1384 catalog_manager.cc:5484] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.571552 1697 leader_election.cc:288] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.571523 1385 catalog_manager.cc:5484] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.571197 1686 raft_consensus.cc:2781] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.571657 1686 raft_consensus.cc:482] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.571693 1686 raft_consensus.cc:3037] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.572475 1686 raft_consensus.cc:504] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.572768 1681 tablet_bootstrap.cc:492] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.572804 1686 leader_election.cc:288] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.572959 1681 ts_tablet_manager.cc:1367] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:01:25.573104 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3127e54a030482ab724e240c2b00c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.573309 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a89ecf63c0a4ebba117030ea7c82610" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.573407 1486 raft_consensus.cc:3037] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
W20240503 08:01:25.573482 1529 leader_election.cc:341] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.573590 1681 raft_consensus.cc:348] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.573681 1681 raft_consensus.cc:374] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.573709 1681 raft_consensus.cc:729] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.573840 1682 tablet_bootstrap.cc:492] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.573935 1682 ts_tablet_manager.cc:1367] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20240503 08:01:25.573832 1681 consensus_queue.cc:260] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.566030 1487 raft_consensus.cc:2454] T 2276ca9aefd240dca8eb751b715b6665 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.574195 1486 raft_consensus.cc:2454] T 2a89ecf63c0a4ebba117030ea7c82610 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.574318 1682 raft_consensus.cc:348] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.574414 1682 raft_consensus.cc:374] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.574388 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3127e54a030482ab724e240c2b00c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.574465 1682 raft_consensus.cc:729] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.574524 1639 raft_consensus.cc:3037] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.574596 1680 ts_tablet_manager.cc:1398] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.574590 1682 consensus_queue.cc:260] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.574854 1682 ts_tablet_manager.cc:1398] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.575021 1682 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.575300 1680 tablet_bootstrap.cc:492] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.574388 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a89ecf63c0a4ebba117030ea7c82610" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.575400 1564 raft_consensus.cc:3037] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.575894 1682 tablet_bootstrap.cc:654] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.576151 1564 raft_consensus.cc:2454] T 2a89ecf63c0a4ebba117030ea7c82610 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.576678 1604 leader_election.cc:302] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.576828 1772 raft_consensus.cc:2781] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.576890 1772 raft_consensus.cc:686] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.576988 1772 consensus_queue.cc:237] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.574460 1681 ts_tablet_manager.cc:1398] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.575286 1639 raft_consensus.cc:2454] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.577351 1528 leader_election.cc:302] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters: 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.577538 1686 raft_consensus.cc:2781] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.577607 1686 raft_consensus.cc:686] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.577711 1686 consensus_queue.cc:237] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.578593 1681 tablet_bootstrap.cc:492] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.576159 1680 tablet_bootstrap.cc:654] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.579499 1681 tablet_bootstrap.cc:654] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.580045 1682 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.580142 1682 ts_tablet_manager.cc:1367] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:01:25.580430 1680 tablet_bootstrap.cc:492] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.580513 1680 ts_tablet_manager.cc:1367] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.580525 1682 raft_consensus.cc:348] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.580709 1681 tablet_bootstrap.cc:492] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.580693 1686 raft_consensus.cc:482] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.580840 1681 ts_tablet_manager.cc:1367] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:01:25.580821 1686 raft_consensus.cc:504] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.580858 1697 raft_consensus.cc:482] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.580914 1680 raft_consensus.cc:348] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.581002 1680 raft_consensus.cc:374] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.581032 1680 raft_consensus.cc:729] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.580924 1697 raft_consensus.cc:504] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.581111 1686 leader_election.cc:288] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.581225 1681 raft_consensus.cc:348] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.581290 1697 leader_election.cc:288] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.580626 1383 catalog_manager.cc:5484] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.581423 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10154920cfd34910be91e017a7968233" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.581305 1681 raft_consensus.cc:374] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.581511 1681 raft_consensus.cc:729] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.581542 1639 raft_consensus.cc:2454] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.581604 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0f89b5529d4d879ec7f408870b466a" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.580741 1682 raft_consensus.cc:374] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.581400 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10154920cfd34910be91e017a7968233" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.581694 1564 raft_consensus.cc:2454] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.581728 1682 raft_consensus.cc:729] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.581772 1486 raft_consensus.cc:2454] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.581857 1682 consensus_queue.cc:260] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.581979 1529 leader_election.cc:302] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.582113 1686 raft_consensus.cc:2781] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.582159 1686 raft_consensus.cc:482] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.582194 1686 raft_consensus.cc:3037] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.582204 1682 ts_tablet_manager.cc:1398] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.582268 1602 leader_election.cc:302] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.582346 1682 tablet_bootstrap.cc:492] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.582485 1697 raft_consensus.cc:2781] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.582536 1697 raft_consensus.cc:482] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.582571 1697 raft_consensus.cc:3037] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.582973 1686 raft_consensus.cc:504] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.583173 1682 tablet_bootstrap.cc:654] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.583290 1686 leader_election.cc:288] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.583355 1697 raft_consensus.cc:504] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.583503 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0f89b5529d4d879ec7f408870b466a" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.583587 1486 raft_consensus.cc:2454] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.583711 1697 leader_election.cc:288] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.583812 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10154920cfd34910be91e017a7968233" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.583882 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10154920cfd34910be91e017a7968233" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.583909 1487 raft_consensus.cc:3037] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.583968 1639 raft_consensus.cc:3037] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.581125 1680 consensus_queue.cc:260] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.584210 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0f89b5529d4d879ec7f408870b466a" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.584283 1564 raft_consensus.cc:3037] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.584378 1680 ts_tablet_manager.cc:1398] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.579947 1385 catalog_manager.cc:5484] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.581633 1681 consensus_queue.cc:260] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.584630 1639 raft_consensus.cc:2454] T 10154920cfd34910be91e017a7968233 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.584884 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0f89b5529d4d879ec7f408870b466a" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.584976 1486 raft_consensus.cc:3037] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.585001 1564 raft_consensus.cc:2454] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.585325 1681 ts_tablet_manager.cc:1398] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240503 08:01:25.585481 1681 tablet_bootstrap.cc:492] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.585700 1486 raft_consensus.cc:2454] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.585922 1528 leader_election.cc:302] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.586097 1602 leader_election.cc:302] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.586234 1772 raft_consensus.cc:2781] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.586294 1772 raft_consensus.cc:686] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.586364 1680 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.586395 1772 consensus_queue.cc:237] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.586448 1681 tablet_bootstrap.cc:654] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.586722 1686 raft_consensus.cc:2781] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.586803 1686 raft_consensus.cc:686] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.586910 1686 consensus_queue.cc:237] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.587179 1680 tablet_bootstrap.cc:654] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.587957 1681 tablet_bootstrap.cc:492] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.584630 1487 raft_consensus.cc:2454] T 10154920cfd34910be91e017a7968233 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.588032 1681 ts_tablet_manager.cc:1367] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:01:25.588555 1681 raft_consensus.cc:348] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.588655 1681 raft_consensus.cc:374] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.588690 1681 raft_consensus.cc:729] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.588800 1681 consensus_queue.cc:260] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.588881 1383 catalog_manager.cc:5484] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.589032 1682 tablet_bootstrap.cc:492] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.589145 1681 ts_tablet_manager.cc:1398] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.589181 1682 ts_tablet_manager.cc:1367] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240503 08:01:25.589304 1681 tablet_bootstrap.cc:492] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.589618 1384 catalog_manager.cc:5484] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.589669 1682 raft_consensus.cc:348] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.589877 1682 raft_consensus.cc:374] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.589965 1682 raft_consensus.cc:729] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.590148 1681 tablet_bootstrap.cc:654] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.590266 1697 raft_consensus.cc:482] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.590337 1697 raft_consensus.cc:504] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.590624 1697 leader_election.cc:288] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.590154 1682 consensus_queue.cc:260] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.590824 1691 raft_consensus.cc:482] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.590884 1691 raft_consensus.cc:504] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.591145 1691 leader_election.cc:288] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.591408 1682 ts_tablet_manager.cc:1398] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.591614 1682 tablet_bootstrap.cc:492] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.591717 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00be723293944a50ad14d0cb4b998fb5" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.591802 1639 raft_consensus.cc:2454] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.591982 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4e300297e84663bcb1b718bfe537ce" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.592082 1564 raft_consensus.cc:2454] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.592276 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00be723293944a50ad14d0cb4b998fb5" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.592370 1487 raft_consensus.cc:2454] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.592425 1682 tablet_bootstrap.cc:654] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.592676 1529 leader_election.cc:302] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.592685 1689 raft_consensus.cc:482] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.592785 1689 raft_consensus.cc:504] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.592945 1691 raft_consensus.cc:2781] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.593010 1691 raft_consensus.cc:482] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.593058 1691 raft_consensus.cc:3037] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.593093 1689 leader_election.cc:288] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.593458 1602 leader_election.cc:302] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.593593 1697 raft_consensus.cc:2781] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.593638 1697 raft_consensus.cc:482] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.593674 1697 raft_consensus.cc:3037] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.593703 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351717c2aada4ff691742452820f96f6" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.593783 1639 raft_consensus.cc:2454] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.593873 1691 raft_consensus.cc:504] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.594064 1452 leader_election.cc:302] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.594182 1691 leader_election.cc:288] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.594211 1689 raft_consensus.cc:2781] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.594254 1689 raft_consensus.cc:482] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.594298 1689 raft_consensus.cc:3037] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.594434 1697 raft_consensus.cc:504] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.594684 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00be723293944a50ad14d0cb4b998fb5" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.594727 1697 leader_election.cc:288] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.594775 1487 raft_consensus.cc:3037] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.594936 1680 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.595003 1680 ts_tablet_manager.cc:1367] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:01:25.595072 1681 tablet_bootstrap.cc:492] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.595059 1689 raft_consensus.cc:504] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.595163 1681 ts_tablet_manager.cc:1367] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20240503 08:01:25.595366 1689 leader_election.cc:288] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.595520 1680 raft_consensus.cc:348] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.595607 1680 raft_consensus.cc:374] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.595559 1681 raft_consensus.cc:348] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.595638 1680 raft_consensus.cc:729] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.595669 1681 raft_consensus.cc:374] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.593014 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4e300297e84663bcb1b718bfe537ce" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.595727 1681 raft_consensus.cc:729] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.595780 1486 raft_consensus.cc:2454] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.595830 1681 consensus_queue.cc:260] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.595777 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351717c2aada4ff691742452820f96f6" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.595571 1487 raft_consensus.cc:2454] T 00be723293944a50ad14d0cb4b998fb5 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.595971 1637 raft_consensus.cc:3037] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.596101 1681 ts_tablet_manager.cc:1398] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.596207 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00be723293944a50ad14d0cb4b998fb5" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.596269 1681 tablet_bootstrap.cc:492] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.596292 1639 raft_consensus.cc:3037] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.596807 1637 raft_consensus.cc:2454] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.596901 1639 raft_consensus.cc:2454] T 00be723293944a50ad14d0cb4b998fb5 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.595767 1680 consensus_queue.cc:260] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.597127 1681 tablet_bootstrap.cc:654] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.597208 1528 leader_election.cc:302] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.597352 1691 raft_consensus.cc:2781] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.597379 1452 leader_election.cc:302] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.597429 1691 raft_consensus.cc:686] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.597544 1691 consensus_queue.cc:237] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.597121 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4e300297e84663bcb1b718bfe537ce" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.597218 1680 ts_tablet_manager.cc:1398] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.597764 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351717c2aada4ff691742452820f96f6" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.597831 1746 raft_consensus.cc:2781] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.597689 1563 raft_consensus.cc:3037] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.597894 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351717c2aada4ff691742452820f96f6" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.597834 1680 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.598608 1563 raft_consensus.cc:2454] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.597910 1746 raft_consensus.cc:686] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.597842 1562 raft_consensus.cc:3037] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.598868 1746 consensus_queue.cc:237] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.599635 1682 tablet_bootstrap.cc:492] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.599642 1562 raft_consensus.cc:2454] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.599721 1682 ts_tablet_manager.cc:1367] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240503 08:01:25.598778 1680 tablet_bootstrap.cc:654] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.600131 1682 raft_consensus.cc:348] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.600226 1682 raft_consensus.cc:374] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.600255 1682 raft_consensus.cc:729] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.600356 1682 consensus_queue.cc:260] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.600734 1682 ts_tablet_manager.cc:1398] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.600929 1682 tablet_bootstrap.cc:492] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.600715 1384 catalog_manager.cc:5484] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.601233 1383 catalog_manager.cc:5484] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.601709 1686 raft_consensus.cc:482] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.601792 1686 raft_consensus.cc:504] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.601799 1602 leader_election.cc:302] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.601974 1697 raft_consensus.cc:2781] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.602051 1697 raft_consensus.cc:686] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.602130 1686 leader_election.cc:288] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.602156 1697 consensus_queue.cc:237] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.602381 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bf366ef12b4fe2bd8db5591267de67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.602485 1639 raft_consensus.cc:2454] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.602710 1528 leader_election.cc:302] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.602756 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bf366ef12b4fe2bd8db5591267de67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.602846 1486 raft_consensus.cc:2454] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.602859 1686 raft_consensus.cc:2781] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.602903 1686 raft_consensus.cc:482] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.602943 1686 raft_consensus.cc:3037] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.601725 1682 tablet_bootstrap.cc:654] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.603482 1680 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.603554 1680 ts_tablet_manager.cc:1367] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:01:25.603847 1686 raft_consensus.cc:504] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.604111 1680 raft_consensus.cc:348] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.604164 1686 leader_election.cc:288] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.604195 1680 raft_consensus.cc:374] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.604224 1680 raft_consensus.cc:729] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.604355 1680 consensus_queue.cc:260] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.604421 1385 catalog_manager.cc:5484] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.604668 1680 ts_tablet_manager.cc:1398] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.604837 1680 tablet_bootstrap.cc:492] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.606119 1681 tablet_bootstrap.cc:492] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.606213 1681 ts_tablet_manager.cc:1367] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240503 08:01:25.606431 1680 tablet_bootstrap.cc:654] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.606462 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bf366ef12b4fe2bd8db5591267de67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.606555 1639 raft_consensus.cc:3037] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.606616 1681 raft_consensus.cc:348] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.606724 1681 raft_consensus.cc:374] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.606770 1681 raft_consensus.cc:729] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.606895 1681 consensus_queue.cc:260] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.607367 1639 raft_consensus.cc:2454] T 39bf366ef12b4fe2bd8db5591267de67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.607684 1528 leader_election.cc:302] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.602710 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4e300297e84663bcb1b718bfe537ce" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.607898 1487 raft_consensus.cc:3037] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.608232 1681 ts_tablet_manager.cc:1398] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.608378 1681 tablet_bootstrap.cc:492] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.608704 1487 raft_consensus.cc:2454] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.608938 1686 raft_consensus.cc:2781] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.609025 1686 raft_consensus.cc:686] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.609139 1686 consensus_queue.cc:237] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.609208 1681 tablet_bootstrap.cc:654] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.609902 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39bf366ef12b4fe2bd8db5591267de67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.610002 1486 raft_consensus.cc:3037] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.610231 1681 tablet_bootstrap.cc:492] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.610296 1681 ts_tablet_manager.cc:1367] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.610657 1681 raft_consensus.cc:348] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.610754 1681 raft_consensus.cc:374] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.610760 1486 raft_consensus.cc:2454] T 39bf366ef12b4fe2bd8db5591267de67 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.610796 1681 raft_consensus.cc:729] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.610844 1385 catalog_manager.cc:5484] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.611034 1681 consensus_queue.cc:260] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.611272 1681 ts_tablet_manager.cc:1398] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.611462 1681 tablet_bootstrap.cc:492] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.612329 1681 tablet_bootstrap.cc:654] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.612818 1682 tablet_bootstrap.cc:492] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.612890 1682 ts_tablet_manager.cc:1367] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20240503 08:01:25.613240 1680 tablet_bootstrap.cc:492] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.613338 1680 ts_tablet_manager.cc:1367] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:01:25.613670 1681 tablet_bootstrap.cc:492] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.613754 1681 ts_tablet_manager.cc:1367] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.613824 1680 raft_consensus.cc:348] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.613948 1680 raft_consensus.cc:374] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.614012 1680 raft_consensus.cc:729] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.614156 1680 consensus_queue.cc:260] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.614228 1681 raft_consensus.cc:348] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.614339 1681 raft_consensus.cc:374] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.614383 1681 raft_consensus.cc:729] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.614522 1680 ts_tablet_manager.cc:1398] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.614495 1681 consensus_queue.cc:260] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.614709 1680 tablet_bootstrap.cc:492] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.614749 1681 ts_tablet_manager.cc:1398] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.614907 1681 tablet_bootstrap.cc:492] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.613294 1682 raft_consensus.cc:348] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.615569 1682 raft_consensus.cc:374] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.615613 1682 raft_consensus.cc:729] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.615770 1681 tablet_bootstrap.cc:654] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.615727 1682 consensus_queue.cc:260] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.616008 1682 ts_tablet_manager.cc:1398] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240503 08:01:25.616168 1682 tablet_bootstrap.cc:492] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.617033 1682 tablet_bootstrap.cc:654] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.617559 1691 raft_consensus.cc:482] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.617635 1691 raft_consensus.cc:504] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.617995 1691 leader_election.cc:288] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.617633 1680 tablet_bootstrap.cc:654] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.618305 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3ab6ff3aec423da20f2a55a038c5b2" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.618518 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3ab6ff3aec423da20f2a55a038c5b2" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
W20240503 08:01:25.618666 1529 leader_election.cc:341] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:01:25.618906 1528 leader_election.cc:341] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.618959 1528 leader_election.cc:302] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.619100 1691 raft_consensus.cc:2726] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.618341 1682 tablet_bootstrap.cc:492] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.619343 1682 ts_tablet_manager.cc:1367] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:01:25.619778 1682 raft_consensus.cc:348] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.619879 1682 raft_consensus.cc:374] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.619911 1682 raft_consensus.cc:729] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.619932 1681 tablet_bootstrap.cc:492] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.619966 1680 tablet_bootstrap.cc:492] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.620008 1681 ts_tablet_manager.cc:1367] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:01:25.620028 1680 ts_tablet_manager.cc:1367] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:01:25.620028 1682 consensus_queue.cc:260] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.620368 1681 raft_consensus.cc:348] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.620448 1681 raft_consensus.cc:374] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.620492 1681 raft_consensus.cc:729] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.620450 1680 raft_consensus.cc:348] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.620589 1680 raft_consensus.cc:374] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.620625 1680 raft_consensus.cc:729] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.620642 1681 consensus_queue.cc:260] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.620723 1680 consensus_queue.cc:260] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.620909 1682 ts_tablet_manager.cc:1398] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:01:25.620999 1680 ts_tablet_manager.cc:1398] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.621055 1681 ts_tablet_manager.cc:1398] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.621074 1682 tablet_bootstrap.cc:492] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.621134 1680 tablet_bootstrap.cc:492] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.621224 1681 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.621978 1680 tablet_bootstrap.cc:654] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.621975 1682 tablet_bootstrap.cc:654] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.622074 1681 tablet_bootstrap.cc:654] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.623085 1680 tablet_bootstrap.cc:492] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.623162 1680 ts_tablet_manager.cc:1367] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.623276 1682 tablet_bootstrap.cc:492] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.623335 1682 ts_tablet_manager.cc:1367] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:01:25.623567 1680 raft_consensus.cc:348] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.623661 1680 raft_consensus.cc:374] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.623695 1680 raft_consensus.cc:729] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.623689 1682 raft_consensus.cc:348] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.623803 1682 raft_consensus.cc:374] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.623842 1682 raft_consensus.cc:729] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.623860 1680 consensus_queue.cc:260] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.623941 1682 consensus_queue.cc:260] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.624166 1682 ts_tablet_manager.cc:1398] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.625149 1682 tablet_bootstrap.cc:492] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.625978 1682 tablet_bootstrap.cc:654] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.624518 1681 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.626689 1681 ts_tablet_manager.cc:1367] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:01:25.626672 1691 raft_consensus.cc:482] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.626791 1691 raft_consensus.cc:504] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.627146 1682 tablet_bootstrap.cc:492] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.627243 1682 ts_tablet_manager.cc:1367] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:01:25.624155 1680 ts_tablet_manager.cc:1398] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.627421 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "457808a6880d407a97940e0e5f87e46b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.627640 1639 raft_consensus.cc:2454] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.627132 1681 raft_consensus.cc:348] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.627686 1682 raft_consensus.cc:348] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.627749 1681 raft_consensus.cc:374] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.627756 1682 raft_consensus.cc:374] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.627795 1681 raft_consensus.cc:729] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.627810 1682 raft_consensus.cc:729] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.627933 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "457808a6880d407a97940e0e5f87e46b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.628008 1681 consensus_queue.cc:260] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.628033 1528 leader_election.cc:302] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.628059 1486 raft_consensus.cc:2454] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.628185 1686 raft_consensus.cc:2781] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.628225 1686 raft_consensus.cc:482] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.628260 1686 raft_consensus.cc:3037] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.628258 1681 ts_tablet_manager.cc:1398] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.627928 1682 consensus_queue.cc:260] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.628443 1681 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.628614 1682 ts_tablet_manager.cc:1398] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.628754 1682 tablet_bootstrap.cc:492] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.629215 1686 raft_consensus.cc:504] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.629319 1681 tablet_bootstrap.cc:654] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.629518 1686 leader_election.cc:288] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.629566 1682 tablet_bootstrap.cc:654] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.629922 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "457808a6880d407a97940e0e5f87e46b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.630031 1639 raft_consensus.cc:3037] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.630465 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "457808a6880d407a97940e0e5f87e46b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.630553 1486 raft_consensus.cc:3037] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.630851 1639 raft_consensus.cc:2454] T 457808a6880d407a97940e0e5f87e46b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.630868 1681 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.630964 1681 ts_tablet_manager.cc:1367] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:01:25.631108 1528 leader_election.cc:302] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.627153 1691 leader_election.cc:288] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.631238 1778 raft_consensus.cc:482] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.631314 1691 raft_consensus.cc:2781] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.631328 1681 raft_consensus.cc:348] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.631422 1691 raft_consensus.cc:686] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.631469 1681 raft_consensus.cc:374] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.631520 1681 raft_consensus.cc:729] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.631565 1691 consensus_queue.cc:237] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.631624 1681 consensus_queue.cc:260] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.631809 1680 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.631883 1681 ts_tablet_manager.cc:1398] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.631304 1486 raft_consensus.cc:2454] T 457808a6880d407a97940e0e5f87e46b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.632066 1681 tablet_bootstrap.cc:492] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.631299 1778 raft_consensus.cc:504] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.632477 1778 leader_election.cc:288] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.632905 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0285ac6e9f884a4abc7a272a664e2406" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.632962 1680 tablet_bootstrap.cc:654] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.633014 1639 raft_consensus.cc:2454] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.633929 1682 tablet_bootstrap.cc:492] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.634009 1682 ts_tablet_manager.cc:1367] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240503 08:01:25.634078 1528 leader_election.cc:302] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.634217 1686 raft_consensus.cc:2781] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.634254 1686 raft_consensus.cc:482] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.634287 1686 raft_consensus.cc:3037] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.634284 1384 catalog_manager.cc:5484] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.634369 1682 raft_consensus.cc:348] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.634456 1682 raft_consensus.cc:374] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.634488 1682 raft_consensus.cc:729] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.634582 1682 consensus_queue.cc:260] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.634837 1682 ts_tablet_manager.cc:1398] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.634996 1682 tablet_bootstrap.cc:492] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.635069 1686 raft_consensus.cc:504] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.635370 1686 leader_election.cc:288] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.635624 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0285ac6e9f884a4abc7a272a664e2406" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.633030 1681 tablet_bootstrap.cc:654] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.635715 1487 raft_consensus.cc:3037] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.635828 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0285ac6e9f884a4abc7a272a664e2406" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.635891 1682 tablet_bootstrap.cc:654] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.635903 1639 raft_consensus.cc:3037] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.636523 1487 raft_consensus.cc:2454] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.636528 1639 raft_consensus.cc:2454] T 0285ac6e9f884a4abc7a272a664e2406 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.636808 1528 leader_election.cc:302] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.636978 1686 raft_consensus.cc:2781] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.637040 1686 raft_consensus.cc:686] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.637053 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0285ac6e9f884a4abc7a272a664e2406" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.637156 1486 raft_consensus.cc:2362] T 0285ac6e9f884a4abc7a272a664e2406 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1. Re-sending same reply.
I20240503 08:01:25.637145 1686 consensus_queue.cc:237] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.638734 1682 tablet_bootstrap.cc:492] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.638814 1682 ts_tablet_manager.cc:1367] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.639158 1682 raft_consensus.cc:348] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.639235 1682 raft_consensus.cc:374] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.639253 1682 raft_consensus.cc:729] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.639355 1682 consensus_queue.cc:260] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.639686 1682 ts_tablet_manager.cc:1398] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.639845 1682 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.640014 1680 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.640092 1680 ts_tablet_manager.cc:1367] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240503 08:01:25.640148 1681 tablet_bootstrap.cc:492] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.640218 1681 ts_tablet_manager.cc:1367] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240503 08:01:25.640136 1384 catalog_manager.cc:5484] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.640483 1680 raft_consensus.cc:348] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.640566 1680 raft_consensus.cc:374] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.640597 1680 raft_consensus.cc:729] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.640586 1681 raft_consensus.cc:348] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.640689 1681 raft_consensus.cc:374] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.640736 1681 raft_consensus.cc:729] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.640754 1680 consensus_queue.cc:260] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.640831 1681 consensus_queue.cc:260] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.641027 1680 ts_tablet_manager.cc:1398] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.641106 1681 ts_tablet_manager.cc:1398] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.641196 1680 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.641263 1681 tablet_bootstrap.cc:492] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.642015 1680 tablet_bootstrap.cc:654] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.642261 1681 tablet_bootstrap.cc:654] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.643064 1682 tablet_bootstrap.cc:654] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.643817 1681 tablet_bootstrap.cc:492] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.643908 1681 ts_tablet_manager.cc:1367] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.644300 1681 raft_consensus.cc:348] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.644397 1681 raft_consensus.cc:374] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.644429 1681 raft_consensus.cc:729] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.644531 1681 consensus_queue.cc:260] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.644866 1681 ts_tablet_manager.cc:1398] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.645249 1681 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.645823 1682 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.645946 1682 ts_tablet_manager.cc:1367] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:01:25.646090 1681 tablet_bootstrap.cc:654] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.646270 1680 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.646353 1680 ts_tablet_manager.cc:1367] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:01:25.646569 1682 raft_consensus.cc:348] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.646657 1682 raft_consensus.cc:374] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.646687 1682 raft_consensus.cc:729] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.646728 1680 raft_consensus.cc:348] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.646838 1680 raft_consensus.cc:374] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.646808 1682 consensus_queue.cc:260] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.646894 1680 raft_consensus.cc:729] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.647017 1680 consensus_queue.cc:260] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.647177 1682 ts_tablet_manager.cc:1398] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.647934 1680 ts_tablet_manager.cc:1398] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.648088 1681 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.648133 1680 tablet_bootstrap.cc:492] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.648253 1681 ts_tablet_manager.cc:1367] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240503 08:01:25.648630 1682 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.649183 1697 raft_consensus.cc:482] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.649255 1697 raft_consensus.cc:504] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.649468 1682 tablet_bootstrap.cc:654] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.649559 1697 leader_election.cc:288] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.649909 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9277beceda64dc3af1f7d0ba9cf9249" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.649920 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9277beceda64dc3af1f7d0ba9cf9249" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.650035 1486 raft_consensus.cc:2454] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.650115 1562 raft_consensus.cc:2454] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.650337 1602 leader_election.cc:302] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.650435 1681 raft_consensus.cc:348] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.650538 1681 raft_consensus.cc:374] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.650574 1681 raft_consensus.cc:729] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.650487 1697 raft_consensus.cc:2781] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.650663 1697 raft_consensus.cc:482] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.650694 1681 consensus_queue.cc:260] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.650739 1697 raft_consensus.cc:3037] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.650969 1681 ts_tablet_manager.cc:1398] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20240503 08:01:25.650985 1680 tablet_bootstrap.cc:654] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.651147 1681 tablet_bootstrap.cc:492] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.651688 1697 raft_consensus.cc:504] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.651921 1681 tablet_bootstrap.cc:654] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.652009 1682 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.652027 1697 leader_election.cc:288] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.652082 1682 ts_tablet_manager.cc:1367] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.652184 1680 tablet_bootstrap.cc:492] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.652254 1680 ts_tablet_manager.cc:1367] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.652468 1682 raft_consensus.cc:348] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.652554 1682 raft_consensus.cc:374] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.652583 1682 raft_consensus.cc:729] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.652642 1680 raft_consensus.cc:348] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.652683 1682 consensus_queue.cc:260] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.652750 1680 raft_consensus.cc:374] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.652783 1680 raft_consensus.cc:729] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.652884 1680 consensus_queue.cc:260] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.652946 1682 ts_tablet_manager.cc:1398] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.653092 1682 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: Bootstrap starting.
I20240503 08:01:25.653149 1680 ts_tablet_manager.cc:1398] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.653280 1680 tablet_bootstrap.cc:492] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.652884 1681 tablet_bootstrap.cc:492] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.653724 1681 ts_tablet_manager.cc:1367] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:01:25.653812 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9277beceda64dc3af1f7d0ba9cf9249" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.653904 1562 raft_consensus.cc:3037] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.654089 1682 tablet_bootstrap.cc:654] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.654177 1681 raft_consensus.cc:348] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.654260 1681 raft_consensus.cc:374] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.654287 1681 raft_consensus.cc:729] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.654382 1681 consensus_queue.cc:260] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.654645 1680 tablet_bootstrap.cc:654] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.654619 1778 raft_consensus.cc:482] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.654630 1681 ts_tablet_manager.cc:1398] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.654721 1778 raft_consensus.cc:504] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.654793 1562 raft_consensus.cc:2454] T a9277beceda64dc3af1f7d0ba9cf9249 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.654829 1681 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.655016 1778 leader_election.cc:288] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.655277 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c219ee9b1aaf4c75a0581d9ea9fcc907" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.655385 1639 raft_consensus.cc:2454] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.655666 1681 tablet_bootstrap.cc:654] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.655766 1528 leader_election.cc:302] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.655774 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c219ee9b1aaf4c75a0581d9ea9fcc907" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.656409 1487 raft_consensus.cc:2454] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.655653 1602 leader_election.cc:302] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.656764 1697 raft_consensus.cc:2781] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.656847 1680 tablet_bootstrap.cc:492] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.656838 1697 raft_consensus.cc:686] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.656917 1778 raft_consensus.cc:2781] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.656947 1680 ts_tablet_manager.cc:1367] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.657029 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9277beceda64dc3af1f7d0ba9cf9249" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.657011 1697 consensus_queue.cc:237] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.657099 1486 raft_consensus.cc:3037] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.657318 1680 raft_consensus.cc:348] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.657404 1680 raft_consensus.cc:374] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.657435 1680 raft_consensus.cc:729] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.657517 1680 consensus_queue.cc:260] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.657790 1680 ts_tablet_manager.cc:1398] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.657869 1486 raft_consensus.cc:2454] T a9277beceda64dc3af1f7d0ba9cf9249 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.657948 1680 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.656955 1778 raft_consensus.cc:482] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.658084 1778 raft_consensus.cc:3037] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.658771 1680 tablet_bootstrap.cc:654] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.658972 1778 raft_consensus.cc:504] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.659211 1681 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.659296 1778 leader_election.cc:288] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.659294 1681 ts_tablet_manager.cc:1367] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.659785 1680 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.659773 1681 raft_consensus.cc:348] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.659821 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c219ee9b1aaf4c75a0581d9ea9fcc907" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.659889 1681 raft_consensus.cc:374] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.659910 1680 ts_tablet_manager.cc:1367] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.659922 1681 raft_consensus.cc:729] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.659940 1639 raft_consensus.cc:3037] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.659978 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c219ee9b1aaf4c75a0581d9ea9fcc907" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.660064 1486 raft_consensus.cc:3037] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.660022 1681 consensus_queue.cc:260] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.660298 1681 ts_tablet_manager.cc:1398] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240503 08:01:25.660290 1680 raft_consensus.cc:348] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.660388 1680 raft_consensus.cc:374] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.660416 1680 raft_consensus.cc:729] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.660476 1681 tablet_bootstrap.cc:492] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.660513 1680 consensus_queue.cc:260] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.660688 1639 raft_consensus.cc:2454] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.660756 1680 ts_tablet_manager.cc:1398] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.660805 1486 raft_consensus.cc:2454] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.660890 1680 tablet_bootstrap.cc:492] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.659785 1682 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: No bootstrap required, opened a new log
I20240503 08:01:25.661006 1682 ts_tablet_manager.cc:1367] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20240503 08:01:25.661300 1681 tablet_bootstrap.cc:654] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.661360 1682 raft_consensus.cc:348] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.661456 1682 raft_consensus.cc:374] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.661486 1682 raft_consensus.cc:729] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.661583 1682 consensus_queue.cc:260] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.661756 1680 tablet_bootstrap.cc:654] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.661868 1682 ts_tablet_manager.cc:1398] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.661931 1529 leader_election.cc:302] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.662108 1686 raft_consensus.cc:2781] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.662170 1686 raft_consensus.cc:686] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.662271 1686 consensus_queue.cc:237] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.663152 1697 raft_consensus.cc:482] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.663244 1697 raft_consensus.cc:504] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.663563 1697 leader_election.cc:288] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.663619 1383 catalog_manager.cc:5484] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.663950 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160b79c11fcc46d79948b6e49888ec84" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.664062 1562 raft_consensus.cc:2454] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.664348 1602 leader_election.cc:302] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.664537 1697 raft_consensus.cc:2781] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.664585 1697 raft_consensus.cc:482] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.664623 1697 raft_consensus.cc:3037] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.665041 1384 catalog_manager.cc:5484] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.665205 1680 tablet_bootstrap.cc:492] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.665272 1680 ts_tablet_manager.cc:1367] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.665453 1697 raft_consensus.cc:504] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.665791 1697 leader_election.cc:288] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.665835 1680 raft_consensus.cc:348] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.665930 1680 raft_consensus.cc:374] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.665982 1680 raft_consensus.cc:729] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.666105 1680 consensus_queue.cc:260] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.666263 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160b79c11fcc46d79948b6e49888ec84" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.666334 1680 ts_tablet_manager.cc:1398] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.666364 1562 raft_consensus.cc:3037] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.666483 1680 tablet_bootstrap.cc:492] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.667272 1562 raft_consensus.cc:2454] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.667542 1602 leader_election.cc:302] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.667588 1681 tablet_bootstrap.cc:492] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.667652 1681 ts_tablet_manager.cc:1367] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20240503 08:01:25.667742 1802 raft_consensus.cc:2781] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.667817 1802 raft_consensus.cc:686] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.667857 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160b79c11fcc46d79948b6e49888ec84" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.667929 1802 consensus_queue.cc:237] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.668057 1681 raft_consensus.cc:348] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.668133 1681 raft_consensus.cc:374] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.668161 1681 raft_consensus.cc:729] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.668251 1681 consensus_queue.cc:260] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.668268 1746 raft_consensus.cc:482] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.668344 1746 raft_consensus.cc:504] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.668571 1681 ts_tablet_manager.cc:1398] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.668646 1746 leader_election.cc:288] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.668781 1681 tablet_bootstrap.cc:492] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
W20240503 08:01:25.669332 1604 leader_election.cc:341] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.669572 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3e1b929d34152b04359d370772926" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.669634 1681 tablet_bootstrap.cc:654] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.669677 1562 raft_consensus.cc:2454] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.669852 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160b79c11fcc46d79948b6e49888ec84" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.669948 1451 leader_election.cc:302] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
W20240503 08:01:25.670148 1604 leader_election.cc:341] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.670130 1746 raft_consensus.cc:2781] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.670209 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3e1b929d34152b04359d370772926" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.670238 1746 raft_consensus.cc:482] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.670284 1746 raft_consensus.cc:3037] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.670291 1639 raft_consensus.cc:2454] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.671056 1691 raft_consensus.cc:482] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.671131 1746 raft_consensus.cc:504] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.671190 1680 tablet_bootstrap.cc:654] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.671458 1746 leader_election.cc:288] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.671135 1691 raft_consensus.cc:504] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.671695 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3e1b929d34152b04359d370772926" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.671787 1639 raft_consensus.cc:3037] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.671846 1691 leader_election.cc:288] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.672207 1680 tablet_bootstrap.cc:492] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.672322 1680 ts_tablet_manager.cc:1367] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:01:25.672593 1639 raft_consensus.cc:2454] T 5af3e1b929d34152b04359d370772926 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.672698 1681 tablet_bootstrap.cc:492] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.672772 1681 ts_tablet_manager.cc:1367] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.672819 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56853fdbc6ab40bdbcf146d71a8d8c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.672919 1637 raft_consensus.cc:2454] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.672880 1383 catalog_manager.cc:5484] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.672928 1680 raft_consensus.cc:348] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.673087 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af3e1b929d34152b04359d370772926" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.673164 1681 raft_consensus.cc:348] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.673218 1562 raft_consensus.cc:3037] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.673239 1681 raft_consensus.cc:374] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.673269 1681 raft_consensus.cc:729] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.673367 1528 leader_election.cc:302] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.673501 1691 raft_consensus.cc:2781] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.673548 1691 raft_consensus.cc:482] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.673548 1452 leader_election.cc:302] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.673610 1691 raft_consensus.cc:3037] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.673705 1746 raft_consensus.cc:2781] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.673770 1746 raft_consensus.cc:686] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.673879 1746 consensus_queue.cc:237] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.673975 1562 raft_consensus.cc:2454] T 5af3e1b929d34152b04359d370772926 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.672772 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56853fdbc6ab40bdbcf146d71a8d8c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.674145 1486 raft_consensus.cc:2454] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.674350 1691 raft_consensus.cc:504] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.674628 1691 leader_election.cc:288] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.674755 1691 raft_consensus.cc:482] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.674827 1691 raft_consensus.cc:504] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.674914 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56853fdbc6ab40bdbcf146d71a8d8c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.674985 1486 raft_consensus.cc:3037] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.675102 1691 leader_election.cc:288] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.675266 1681 consensus_queue.cc:260] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.675601 1681 ts_tablet_manager.cc:1398] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.675652 1486 raft_consensus.cc:2454] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.675776 1681 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.675616 1384 catalog_manager.cc:5484] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.676034 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56853fdbc6ab40bdbcf146d71a8d8c72" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.676148 1637 raft_consensus.cc:3037] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.676295 1529 leader_election.cc:302] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.676474 1686 raft_consensus.cc:482] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.676543 1686 raft_consensus.cc:504] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.676679 1681 tablet_bootstrap.cc:654] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.676849 1686 leader_election.cc:288] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.676928 1686 raft_consensus.cc:2781] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.676964 1637 raft_consensus.cc:2454] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.676985 1686 raft_consensus.cc:686] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.677268 1686 consensus_queue.cc:237] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.677471 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12066e116ad446119c3e940a9ac37f12" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.677749 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c436d20ad34f455ea1ac00e72e2118fd" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.677856 1486 raft_consensus.cc:2454] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.678074 1529 leader_election.cc:302] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.678182 1680 raft_consensus.cc:374] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.678215 1680 raft_consensus.cc:729] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.677755 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12066e116ad446119c3e940a9ac37f12" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
W20240503 08:01:25.678539 1528 leader_election.cc:341] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:01:25.678619 1529 leader_election.cc:341] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:01:25.678663 1686 raft_consensus.cc:2781] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.678694 1529 leader_election.cc:302] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 171fd27a77964e6588327f262ecffc39; no voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.678802 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c436d20ad34f455ea1ac00e72e2118fd" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.678887 1639 raft_consensus.cc:2454] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.678709 1686 raft_consensus.cc:482] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.679015 1686 raft_consensus.cc:3037] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.679236 1691 raft_consensus.cc:2726] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.679348 1680 consensus_queue.cc:260] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.679416 1384 catalog_manager.cc:5484] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.679633 1680 ts_tablet_manager.cc:1398] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:01:25.679786 1680 tablet_bootstrap.cc:492] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.679797 1686 raft_consensus.cc:504] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.680389 1686 leader_election.cc:288] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.680583 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c436d20ad34f455ea1ac00e72e2118fd" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.680670 1487 raft_consensus.cc:3037] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.680694 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c436d20ad34f455ea1ac00e72e2118fd" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.680761 1639 raft_consensus.cc:3037] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.680802 1680 tablet_bootstrap.cc:654] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.681411 1487 raft_consensus.cc:2454] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.681411 1639 raft_consensus.cc:2454] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.681702 1528 leader_election.cc:302] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.681861 1686 raft_consensus.cc:2781] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.681931 1686 raft_consensus.cc:686] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.682032 1686 consensus_queue.cc:237] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.683276 1680 tablet_bootstrap.cc:492] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.683367 1680 ts_tablet_manager.cc:1367] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.683276 1681 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.683578 1681 ts_tablet_manager.cc:1367] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240503 08:01:25.683718 1680 raft_consensus.cc:348] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.683801 1680 raft_consensus.cc:374] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.683827 1680 raft_consensus.cc:729] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.683905 1680 consensus_queue.cc:260] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.684149 1680 ts_tablet_manager.cc:1398] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.684166 1681 raft_consensus.cc:348] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.684329 1681 raft_consensus.cc:374] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.684392 1681 raft_consensus.cc:729] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.684417 1680 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.684566 1681 consensus_queue.cc:260] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.684661 1384 catalog_manager.cc:5484] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.684906 1681 ts_tablet_manager.cc:1398] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.685094 1681 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.685488 1680 tablet_bootstrap.cc:654] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.686432 1681 tablet_bootstrap.cc:654] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.687585 1680 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.687673 1680 ts_tablet_manager.cc:1367] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.687809 1681 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.687883 1681 ts_tablet_manager.cc:1367] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:01:25.688060 1680 raft_consensus.cc:348] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.688148 1680 raft_consensus.cc:374] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.688176 1680 raft_consensus.cc:729] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.688277 1680 consensus_queue.cc:260] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.688264 1681 raft_consensus.cc:348] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.688390 1681 raft_consensus.cc:374] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.688426 1681 raft_consensus.cc:729] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.688542 1681 consensus_queue.cc:260] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.688659 1680 ts_tablet_manager.cc:1398] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.688889 1681 ts_tablet_manager.cc:1398] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.688903 1680 tablet_bootstrap.cc:492] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.689046 1681 tablet_bootstrap.cc:492] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.689882 1681 tablet_bootstrap.cc:654] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.689965 1680 tablet_bootstrap.cc:654] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.690855 1681 tablet_bootstrap.cc:492] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.690929 1681 ts_tablet_manager.cc:1367] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.691080 1680 tablet_bootstrap.cc:492] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.691154 1680 ts_tablet_manager.cc:1367] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.691310 1681 raft_consensus.cc:348] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.691396 1681 raft_consensus.cc:374] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.691466 1681 raft_consensus.cc:729] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.691579 1680 raft_consensus.cc:348] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.691577 1681 consensus_queue.cc:260] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.691707 1680 raft_consensus.cc:374] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.691737 1680 raft_consensus.cc:729] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.691890 1681 ts_tablet_manager.cc:1398] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.691952 1680 consensus_queue.cc:260] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.692095 1681 tablet_bootstrap.cc:492] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.692193 1680 ts_tablet_manager.cc:1398] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.692360 1680 tablet_bootstrap.cc:492] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.692957 1681 tablet_bootstrap.cc:654] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.693188 1680 tablet_bootstrap.cc:654] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.694347 1681 tablet_bootstrap.cc:492] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.694425 1681 ts_tablet_manager.cc:1367] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.694598 1680 tablet_bootstrap.cc:492] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.694669 1680 ts_tablet_manager.cc:1367] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.694785 1681 raft_consensus.cc:348] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.694872 1681 raft_consensus.cc:374] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.694903 1681 raft_consensus.cc:729] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.694995 1680 raft_consensus.cc:348] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.695009 1681 consensus_queue.cc:260] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.695108 1680 raft_consensus.cc:374] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.695138 1680 raft_consensus.cc:729] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.695232 1680 consensus_queue.cc:260] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.695302 1681 ts_tablet_manager.cc:1398] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.695519 1680 ts_tablet_manager.cc:1398] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.695545 1681 tablet_bootstrap.cc:492] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.695742 1680 tablet_bootstrap.cc:492] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.696295 1681 tablet_bootstrap.cc:654] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.697124 1680 tablet_bootstrap.cc:654] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.697711 1681 tablet_bootstrap.cc:492] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.697785 1681 ts_tablet_manager.cc:1367] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.698148 1681 raft_consensus.cc:348] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.698225 1681 raft_consensus.cc:374] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.698254 1681 raft_consensus.cc:729] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.698367 1681 consensus_queue.cc:260] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.698675 1681 ts_tablet_manager.cc:1398] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.698711 1686 raft_consensus.cc:482] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.698784 1686 raft_consensus.cc:504] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.699084 1686 leader_election.cc:288] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.699342 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32dcb8f792b747eeb0bcb0e3bec65e42" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.699383 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32dcb8f792b747eeb0bcb0e3bec65e42" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.699487 1680 tablet_bootstrap.cc:492] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.699468 1639 raft_consensus.cc:2454] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.699505 1487 raft_consensus.cc:2454] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.699564 1680 ts_tablet_manager.cc:1367] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:25.699715 1529 leader_election.cc:302] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.699955 1686 raft_consensus.cc:2781] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.699924 1680 raft_consensus.cc:348] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.700016 1686 raft_consensus.cc:482] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.700035 1680 raft_consensus.cc:374] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.700049 1686 raft_consensus.cc:3037] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.700204 1681 tablet_bootstrap.cc:492] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.700937 1681 tablet_bootstrap.cc:654] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.700960 1680 raft_consensus.cc:729] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.701108 1680 consensus_queue.cc:260] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.700945 1686 raft_consensus.cc:504] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.701525 1686 leader_election.cc:288] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.701773 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32dcb8f792b747eeb0bcb0e3bec65e42" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.701838 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32dcb8f792b747eeb0bcb0e3bec65e42" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.701867 1639 raft_consensus.cc:3037] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.701903 1487 raft_consensus.cc:3037] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.701932 1680 ts_tablet_manager.cc:1398] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.702080 1680 tablet_bootstrap.cc:492] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.702631 1487 raft_consensus.cc:2454] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.702631 1639 raft_consensus.cc:2454] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.702880 1529 leader_election.cc:302] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.702915 1680 tablet_bootstrap.cc:654] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.703097 1686 raft_consensus.cc:2781] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.703184 1686 raft_consensus.cc:686] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.703323 1686 consensus_queue.cc:237] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.703833 1680 tablet_bootstrap.cc:492] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.704012 1681 tablet_bootstrap.cc:492] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.704037 1680 ts_tablet_manager.cc:1367] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.704118 1681 ts_tablet_manager.cc:1367] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:01:25.704414 1680 raft_consensus.cc:348] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.704514 1680 raft_consensus.cc:374] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.704551 1680 raft_consensus.cc:729] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.704661 1680 consensus_queue.cc:260] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.704675 1681 raft_consensus.cc:348] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.704762 1681 raft_consensus.cc:374] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.704797 1681 raft_consensus.cc:729] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.704927 1680 ts_tablet_manager.cc:1398] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.704903 1681 consensus_queue.cc:260] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.705099 1680 tablet_bootstrap.cc:492] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89: Bootstrap starting.
I20240503 08:01:25.705147 1383 catalog_manager.cc:5484] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.705684 1681 ts_tablet_manager.cc:1398] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:25.705837 1681 tablet_bootstrap.cc:492] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.705878 1680 tablet_bootstrap.cc:654] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.706684 1681 tablet_bootstrap.cc:654] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.707423 1680 tablet_bootstrap.cc:492] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89: No bootstrap required, opened a new log
I20240503 08:01:25.707531 1680 ts_tablet_manager.cc:1367] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.707914 1680 raft_consensus.cc:348] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.708009 1680 raft_consensus.cc:374] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.708034 1680 raft_consensus.cc:729] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.708128 1680 consensus_queue.cc:260] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.708321 1681 tablet_bootstrap.cc:492] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.708374 1680 ts_tablet_manager.cc:1398] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.708377 1681 ts_tablet_manager.cc:1367] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:01:25.708750 1681 raft_consensus.cc:348] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.708835 1681 raft_consensus.cc:374] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.708856 1681 raft_consensus.cc:729] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.708940 1681 consensus_queue.cc:260] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.709249 1681 ts_tablet_manager.cc:1398] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:25.709460 1681 tablet_bootstrap.cc:492] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7: Bootstrap starting.
I20240503 08:01:25.710366 1681 tablet_bootstrap.cc:654] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7: Neither blocks nor log segments found. Creating new log.
I20240503 08:01:25.711812 1681 tablet_bootstrap.cc:492] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7: No bootstrap required, opened a new log
I20240503 08:01:25.711886 1681 ts_tablet_manager.cc:1367] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:01:25.712256 1681 raft_consensus.cc:348] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.712347 1681 raft_consensus.cc:374] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:01:25.712378 1681 raft_consensus.cc:729] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Initialized, Role: FOLLOWER
I20240503 08:01:25.712482 1681 consensus_queue.cc:260] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.712715 1681 ts_tablet_manager.cc:1398] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:25.718297 1697 raft_consensus.cc:482] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.718377 1697 raft_consensus.cc:504] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.718673 1697 leader_election.cc:288] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.718962 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509a9c384f4c448a9fb048e0d6ff8563" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.718962 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509a9c384f4c448a9fb048e0d6ff8563" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.719115 1562 raft_consensus.cc:2454] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.719115 1487 raft_consensus.cc:2454] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.719385 1602 leader_election.cc:302] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.719579 1697 raft_consensus.cc:2781] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.719630 1697 raft_consensus.cc:482] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.719656 1697 raft_consensus.cc:3037] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.720345 1697 raft_consensus.cc:504] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.720654 1697 leader_election.cc:288] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.720870 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509a9c384f4c448a9fb048e0d6ff8563" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.720909 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509a9c384f4c448a9fb048e0d6ff8563" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.720961 1487 raft_consensus.cc:3037] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.721001 1562 raft_consensus.cc:3037] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.721583 1487 raft_consensus.cc:2454] T 509a9c384f4c448a9fb048e0d6ff8563 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.721625 1562 raft_consensus.cc:2454] T 509a9c384f4c448a9fb048e0d6ff8563 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.721870 1602 leader_election.cc:302] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.722023 1697 raft_consensus.cc:2781] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.722105 1697 raft_consensus.cc:686] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.722230 1697 consensus_queue.cc:237] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.723819 1383 catalog_manager.cc:5484] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.730620 1686 raft_consensus.cc:482] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.730715 1686 raft_consensus.cc:504] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.730981 1686 leader_election.cc:288] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.731257 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64a657fff614834aabcb06e2197030b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.731277 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64a657fff614834aabcb06e2197030b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.731359 1487 raft_consensus.cc:2454] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.731374 1639 raft_consensus.cc:2454] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.731611 1529 leader_election.cc:302] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.731761 1686 raft_consensus.cc:2781] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.731817 1686 raft_consensus.cc:482] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.731843 1686 raft_consensus.cc:3037] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.732539 1686 raft_consensus.cc:504] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.732735 1697 raft_consensus.cc:482] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.732810 1697 raft_consensus.cc:504] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.732833 1686 leader_election.cc:288] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.733072 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64a657fff614834aabcb06e2197030b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.733139 1697 leader_election.cc:288] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.733145 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64a657fff614834aabcb06e2197030b" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.733165 1487 raft_consensus.cc:3037] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.733275 1639 raft_consensus.cc:3037] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.733845 1487 raft_consensus.cc:2454] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.733868 1639 raft_consensus.cc:2454] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.734054 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "589889a5006a4fccaa237697405fda28" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.734073 1529 leader_election.cc:302] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.734210 1686 raft_consensus.cc:2781] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.734310 1686 raft_consensus.cc:686] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.734338 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "589889a5006a4fccaa237697405fda28" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.734463 1562 raft_consensus.cc:2379] T 589889a5006a4fccaa237697405fda28 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f870be2d05c49bbab11db8ad76d6c89 in current term 1: Already voted for candidate 8f4fcb24282e423cb788be167a3540e7 in this term.
I20240503 08:01:25.734437 1686 consensus_queue.cc:237] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.735131 1697 raft_consensus.cc:482] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.735173 1604 leader_election.cc:302] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f870be2d05c49bbab11db8ad76d6c89; no voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7
I20240503 08:01:25.735204 1697 raft_consensus.cc:504] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.735343 1772 raft_consensus.cc:3037] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.735505 1697 leader_election.cc:288] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.735919 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7091489ce2b94c82abd265d81c5e38d3" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.736032 1562 raft_consensus.cc:2454] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.736155 1772 raft_consensus.cc:2726] T 589889a5006a4fccaa237697405fda28 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.736256 1602 leader_election.cc:302] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.736409 1772 raft_consensus.cc:2781] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.736455 1772 raft_consensus.cc:482] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.736495 1772 raft_consensus.cc:3037] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.736472 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7091489ce2b94c82abd265d81c5e38d3" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.736619 1486 raft_consensus.cc:2454] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.736728 1383 catalog_manager.cc:5484] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.737172 1772 raft_consensus.cc:504] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.737437 1772 leader_election.cc:288] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.737684 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7091489ce2b94c82abd265d81c5e38d3" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.737792 1562 raft_consensus.cc:3037] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.737856 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7091489ce2b94c82abd265d81c5e38d3" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.737936 1486 raft_consensus.cc:3037] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.738545 1562 raft_consensus.cc:2454] T 7091489ce2b94c82abd265d81c5e38d3 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.738574 1486 raft_consensus.cc:2454] T 7091489ce2b94c82abd265d81c5e38d3 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.738773 1604 leader_election.cc:302] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.738905 1772 raft_consensus.cc:2781] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.738984 1772 raft_consensus.cc:686] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.739135 1772 consensus_queue.cc:237] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.740753 1383 catalog_manager.cc:5484] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.762090 1689 raft_consensus.cc:482] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.762230 1689 raft_consensus.cc:504] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.762670 1689 leader_election.cc:288] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.763024 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160b79c11fcc46d79948b6e49888ec84" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.763025 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160b79c11fcc46d79948b6e49888ec84" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.763188 1562 raft_consensus.cc:2379] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f4fcb24282e423cb788be167a3540e7 in current term 1: Already voted for candidate 9f870be2d05c49bbab11db8ad76d6c89 in this term.
I20240503 08:01:25.763481 1451 leader_election.cc:302] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7; no voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.763630 1689 raft_consensus.cc:3037] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.764647 1689 raft_consensus.cc:2726] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.767621 1772 raft_consensus.cc:482] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.767714 1772 raft_consensus.cc:504] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.768075 1772 leader_election.cc:288] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.768366 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12066e116ad446119c3e940a9ac37f12" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.768411 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12066e116ad446119c3e940a9ac37f12" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.768468 1486 raft_consensus.cc:2454] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.768532 1562 raft_consensus.cc:2454] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.768793 1604 leader_election.cc:302] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.769222 1772 raft_consensus.cc:2781] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.769284 1772 raft_consensus.cc:482] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.769311 1772 raft_consensus.cc:3037] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.770037 1772 raft_consensus.cc:504] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.770339 1772 leader_election.cc:288] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.770632 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12066e116ad446119c3e940a9ac37f12" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.770653 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12066e116ad446119c3e940a9ac37f12" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.770746 1486 raft_consensus.cc:3037] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.770769 1562 raft_consensus.cc:3037] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.771615 1486 raft_consensus.cc:2454] T 12066e116ad446119c3e940a9ac37f12 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.771615 1562 raft_consensus.cc:2454] T 12066e116ad446119c3e940a9ac37f12 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.771908 1602 leader_election.cc:302] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.772076 1772 raft_consensus.cc:2781] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.772157 1772 raft_consensus.cc:686] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.772295 1772 consensus_queue.cc:237] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.773615 1772 consensus_queue.cc:1035] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.774379 1383 catalog_manager.cc:5484] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.776934 1697 consensus_queue.cc:1035] T 813ec1f7162b4b9e96f72c9ae496e387 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.780552 1697 raft_consensus.cc:482] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.780642 1697 raft_consensus.cc:504] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.780951 1697 leader_election.cc:288] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.781152 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3937ed53708473da219f5847f26a99d" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.781183 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3937ed53708473da219f5847f26a99d" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.781280 1562 raft_consensus.cc:2454] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.781280 1486 raft_consensus.cc:2454] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.781503 1604 leader_election.cc:302] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.781648 1697 raft_consensus.cc:2781] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.781724 1697 raft_consensus.cc:482] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.781791 1697 raft_consensus.cc:3037] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.782496 1697 raft_consensus.cc:504] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.782792 1697 leader_election.cc:288] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.783346 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3937ed53708473da219f5847f26a99d" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.783514 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3937ed53708473da219f5847f26a99d" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.783537 1486 raft_consensus.cc:3037] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.783776 1562 raft_consensus.cc:3037] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.784451 1486 raft_consensus.cc:2454] T e3937ed53708473da219f5847f26a99d P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.784490 1562 raft_consensus.cc:2454] T e3937ed53708473da219f5847f26a99d P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.784696 1604 leader_election.cc:302] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.784901 1697 raft_consensus.cc:2781] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.784976 1697 raft_consensus.cc:686] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.785132 1697 consensus_queue.cc:237] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.786942 1383 catalog_manager.cc:5484] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.787304 1691 consensus_queue.cc:1035] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.788632 1689 consensus_queue.cc:1035] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.790474 1689 raft_consensus.cc:482] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.790555 1689 raft_consensus.cc:504] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.790633 1686 consensus_queue.cc:1035] T c56e1683d2844f9b887ccccce86842f6 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.790863 1689 leader_election.cc:288] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.791085 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3ab6ff3aec423da20f2a55a038c5b2" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.791203 1562 raft_consensus.cc:2454] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.791239 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3ab6ff3aec423da20f2a55a038c5b2" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.791352 1637 raft_consensus.cc:2454] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.791554 1451 leader_election.cc:302] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.791694 1689 raft_consensus.cc:2781] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.791741 1689 raft_consensus.cc:482] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.791764 1686 raft_consensus.cc:482] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.791846 1686 raft_consensus.cc:504] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.792129 1686 leader_election.cc:288] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.791795 1689 raft_consensus.cc:3037] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.793074 1689 raft_consensus.cc:504] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.793287 1562 raft_consensus.cc:3037] T 05394f63db6744a1921172d09e43e020 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.793375 1689 leader_election.cc:288] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.793882 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3ab6ff3aec423da20f2a55a038c5b2" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.793968 1563 raft_consensus.cc:3037] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.794015 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3ab6ff3aec423da20f2a55a038c5b2" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.794104 1637 raft_consensus.cc:3037] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.793288 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0156bfa7c8465d80d93ab1301a0e67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.794325 1487 raft_consensus.cc:2454] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.794642 1529 leader_election.cc:302] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.794752 1563 raft_consensus.cc:2454] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.794806 1637 raft_consensus.cc:2454] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.795006 1451 leader_election.cc:302] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.795089 1685 consensus_queue.cc:1035] T 05394f63db6744a1921172d09e43e020 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.795260 1746 raft_consensus.cc:2781] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.795329 1746 raft_consensus.cc:686] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.795488 1746 consensus_queue.cc:237] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.796124 1686 raft_consensus.cc:2781] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.796181 1686 raft_consensus.cc:482] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.796226 1686 raft_consensus.cc:3037] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.796985 1686 raft_consensus.cc:504] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.797084 1697 consensus_queue.cc:1035] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.797253 1686 leader_election.cc:288] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.797582 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0156bfa7c8465d80d93ab1301a0e67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.797680 1488 raft_consensus.cc:3037] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.797633 1383 catalog_manager.cc:5484] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.798475 1488 raft_consensus.cc:2454] T 3d0156bfa7c8465d80d93ab1301a0e67 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.798862 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0156bfa7c8465d80d93ab1301a0e67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.798933 1529 leader_election.cc:302] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.798960 1639 raft_consensus.cc:3037] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.799072 1691 raft_consensus.cc:2781] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.799165 1691 raft_consensus.cc:686] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.799285 1691 consensus_queue.cc:237] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.799719 1639 raft_consensus.cc:2454] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.800361 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0156bfa7c8465d80d93ab1301a0e67" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.800453 1637 raft_consensus.cc:2362] T 3d0156bfa7c8465d80d93ab1301a0e67 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1. Re-sending same reply.
I20240503 08:01:25.801015 1384 catalog_manager.cc:5484] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.803862 1772 consensus_queue.cc:1035] T 418513984d364a129eebf2a2f49626b1 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.832684 1689 raft_consensus.cc:482] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.832844 1689 raft_consensus.cc:504] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.833236 1689 leader_election.cc:288] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.833601 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39413e968c2548229bf4026e1c278d94" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.833706 1637 raft_consensus.cc:2454] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.833789 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39413e968c2548229bf4026e1c278d94" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.833882 1563 raft_consensus.cc:2454] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.833992 1452 leader_election.cc:302] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.834167 1689 raft_consensus.cc:2781] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.834229 1689 raft_consensus.cc:482] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.834256 1689 raft_consensus.cc:3037] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.835063 1689 raft_consensus.cc:504] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.835342 1689 leader_election.cc:288] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.835644 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39413e968c2548229bf4026e1c278d94" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.835672 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39413e968c2548229bf4026e1c278d94" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.835740 1563 raft_consensus.cc:3037] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.835788 1637 raft_consensus.cc:3037] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.836439 1563 raft_consensus.cc:2454] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.836464 1637 raft_consensus.cc:2454] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.836686 1451 leader_election.cc:302] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.836869 1689 raft_consensus.cc:2781] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.836942 1689 raft_consensus.cc:686] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.837085 1689 consensus_queue.cc:237] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.838775 1383 catalog_manager.cc:5484] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.850163 1686 raft_consensus.cc:482] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.850279 1686 raft_consensus.cc:504] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.850656 1686 leader_election.cc:288] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.850677 1689 consensus_queue.cc:1035] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.850847 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3745831794490b9318a7ba5e65c505" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.850957 1486 raft_consensus.cc:2454] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.851145 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3745831794490b9318a7ba5e65c505" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.851240 1637 raft_consensus.cc:2454] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.851250 1529 leader_election.cc:302] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.851536 1686 raft_consensus.cc:2781] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.851593 1686 raft_consensus.cc:482] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.851637 1686 raft_consensus.cc:3037] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.851809 1691 consensus_queue.cc:1035] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.852614 1686 raft_consensus.cc:504] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.852929 1686 leader_election.cc:288] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.853201 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3745831794490b9318a7ba5e65c505" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.853286 1637 raft_consensus.cc:3037] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.853727 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3745831794490b9318a7ba5e65c505" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.853832 1486 raft_consensus.cc:3037] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.854097 1637 raft_consensus.cc:2454] T 9a3745831794490b9318a7ba5e65c505 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.854460 1528 leader_election.cc:302] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.854612 1486 raft_consensus.cc:2454] T 9a3745831794490b9318a7ba5e65c505 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.854874 1778 raft_consensus.cc:2781] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.854948 1778 raft_consensus.cc:686] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.855070 1778 consensus_queue.cc:237] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.855682 1778 consensus_queue.cc:1035] T 76e77365e9a143fbb8d43e3fd0308ffb P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.857676 1746 consensus_queue.cc:1035] T 589889a5006a4fccaa237697405fda28 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.861671 1384 catalog_manager.cc:5484] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.863157 1746 raft_consensus.cc:482] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.863245 1746 raft_consensus.cc:504] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.863600 1746 leader_election.cc:288] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.863790 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb31c5818e7c45baacaf69e36a746fc7" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.863895 1563 raft_consensus.cc:2454] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.863940 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb31c5818e7c45baacaf69e36a746fc7" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.864022 1639 raft_consensus.cc:2454] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.864110 1451 leader_election.cc:302] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.864295 1746 raft_consensus.cc:2781] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.864346 1746 raft_consensus.cc:482] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.864384 1746 raft_consensus.cc:3037] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.865176 1746 raft_consensus.cc:504] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.865491 1746 leader_election.cc:288] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.865772 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb31c5818e7c45baacaf69e36a746fc7" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.865772 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb31c5818e7c45baacaf69e36a746fc7" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.865917 1563 raft_consensus.cc:3037] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.865917 1639 raft_consensus.cc:3037] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.866791 1563 raft_consensus.cc:2454] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.866787 1639 raft_consensus.cc:2454] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.867086 1452 leader_election.cc:302] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.867260 1746 raft_consensus.cc:2781] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.867347 1746 raft_consensus.cc:686] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.867506 1746 consensus_queue.cc:237] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.869277 1384 catalog_manager.cc:5484] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.886289 1686 raft_consensus.cc:482] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.886411 1686 raft_consensus.cc:504] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.886766 1686 leader_election.cc:288] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.887127 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71ba268c9b4c4e059c86d3804eb9513d" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.887130 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71ba268c9b4c4e059c86d3804eb9513d" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.887235 1486 raft_consensus.cc:2454] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.887277 1639 raft_consensus.cc:2454] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.887538 1529 leader_election.cc:302] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.887696 1686 raft_consensus.cc:2781] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.887746 1686 raft_consensus.cc:482] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.887784 1686 raft_consensus.cc:3037] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.888525 1686 raft_consensus.cc:504] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.888844 1686 leader_election.cc:288] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.889117 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71ba268c9b4c4e059c86d3804eb9513d" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.889117 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71ba268c9b4c4e059c86d3804eb9513d" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.889264 1639 raft_consensus.cc:3037] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.889266 1486 raft_consensus.cc:3037] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.889470 1686 raft_consensus.cc:482] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.889595 1686 raft_consensus.cc:504] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.889914 1686 leader_election.cc:288] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.890089 1486 raft_consensus.cc:2454] T 71ba268c9b4c4e059c86d3804eb9513d P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.890089 1639 raft_consensus.cc:2454] T 71ba268c9b4c4e059c86d3804eb9513d P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.890168 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7cc8dc5aae46b3903508c4060666d7" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.890254 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7cc8dc5aae46b3903508c4060666d7" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.890269 1487 raft_consensus.cc:2454] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.890333 1637 raft_consensus.cc:2454] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.890502 1529 leader_election.cc:302] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.890650 1686 raft_consensus.cc:2781] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.890652 1528 leader_election.cc:302] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.890743 1686 raft_consensus.cc:686] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.890910 1778 raft_consensus.cc:2781] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.890972 1778 raft_consensus.cc:482] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.891017 1778 raft_consensus.cc:3037] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.891839 1778 raft_consensus.cc:504] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.892103 1778 leader_election.cc:288] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.890882 1686 consensus_queue.cc:237] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.892361 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7cc8dc5aae46b3903508c4060666d7" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.892457 1637 raft_consensus.cc:3037] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.892709 1746 raft_consensus.cc:482] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.892777 1746 raft_consensus.cc:504] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.893278 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a053f3bfd984b82b2d6ea6e833e2245" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.893332 1746 leader_election.cc:288] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.893364 1772 raft_consensus.cc:482] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.893378 1639 raft_consensus.cc:2454] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.893420 1772 raft_consensus.cc:504] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.893647 1452 leader_election.cc:302] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.893688 1772 leader_election.cc:288] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.893779 1746 raft_consensus.cc:2781] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.893816 1746 raft_consensus.cc:482] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.893815 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7cc8dc5aae46b3903508c4060666d7" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.893889 1746 raft_consensus.cc:3037] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.893922 1487 raft_consensus.cc:3037] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.894102 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a053f3bfd984b82b2d6ea6e833e2245" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.894193 1563 raft_consensus.cc:2454] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:25.894642 1487 raft_consensus.cc:2454] T 5e7cc8dc5aae46b3903508c4060666d7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.894780 1746 raft_consensus.cc:504] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.894841 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907a3bdbd3454c4b8381fd68330bc2a0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.894908 1529 leader_election.cc:302] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.894922 1564 raft_consensus.cc:2454] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.895088 1686 raft_consensus.cc:2781] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.895181 1686 raft_consensus.cc:686] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.895200 1602 leader_election.cc:302] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.895196 1772 consensus_queue.cc:1035] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.895308 1686 consensus_queue.cc:237] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.895363 1710 raft_consensus.cc:2781] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.895399 1710 raft_consensus.cc:482] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.895453 1710 raft_consensus.cc:3037] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.895490 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a053f3bfd984b82b2d6ea6e833e2245" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.895550 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a053f3bfd984b82b2d6ea6e833e2245" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.895589 1564 raft_consensus.cc:3037] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.895613 1639 raft_consensus.cc:3037] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.896201 1710 raft_consensus.cc:504] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.896333 1639 raft_consensus.cc:2454] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.896497 1710 leader_election.cc:288] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.896550 1452 leader_election.cc:302] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.896477 1746 leader_election.cc:288] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.896728 1685 raft_consensus.cc:2781] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.896811 1685 raft_consensus.cc:686] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:25.896883 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907a3bdbd3454c4b8381fd68330bc2a0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.893292 1637 raft_consensus.cc:2454] T 5e7cc8dc5aae46b3903508c4060666d7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.896975 1486 raft_consensus.cc:3037] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.896951 1685 consensus_queue.cc:237] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.896886 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907a3bdbd3454c4b8381fd68330bc2a0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.896333 1564 raft_consensus.cc:2454] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:25.897698 1486 raft_consensus.cc:2454] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.897765 1384 catalog_manager.cc:5484] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.897878 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "907a3bdbd3454c4b8381fd68330bc2a0" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.897926 1604 leader_election.cc:302] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.897970 1562 raft_consensus.cc:3037] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.898067 1710 raft_consensus.cc:2781] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.898171 1710 raft_consensus.cc:686] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.898281 1710 consensus_queue.cc:237] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.898725 1562 raft_consensus.cc:2454] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.900348 1383 catalog_manager.cc:5484] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.901690 1486 raft_consensus.cc:3037] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.902112 1384 catalog_manager.cc:5484] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.902102 1385 catalog_manager.cc:5484] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.902763 1697 consensus_queue.cc:1035] T 2936bd2bc39d4456a9886b2b10e9b4c0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.907557 1697 consensus_queue.cc:1035] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.909682 1802 consensus_queue.cc:1035] T 3d3f7b80c0144221b60aac076bb330bd P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.914487 1746 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.916764 1689 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.920512 1686 consensus_queue.cc:1035] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.923314 1778 consensus_queue.cc:1035] T 07a79a5bc33441e0954896919f0e9da8 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.925446 1802 raft_consensus.cc:482] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.925524 1802 raft_consensus.cc:504] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.925853 1802 leader_election.cc:288] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.926026 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a4c4ffcbd54a10b58312533628c560" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.926136 1486 raft_consensus.cc:2454] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.926227 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a4c4ffcbd54a10b58312533628c560" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.926326 1563 raft_consensus.cc:2454] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.926393 1604 leader_election.cc:302] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.926630 1802 raft_consensus.cc:2781] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.926687 1802 raft_consensus.cc:482] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.926724 1802 raft_consensus.cc:3037] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.927582 1802 raft_consensus.cc:504] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.927906 1802 leader_election.cc:288] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.928145 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a4c4ffcbd54a10b58312533628c560" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.928145 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a4c4ffcbd54a10b58312533628c560" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.928269 1563 raft_consensus.cc:3037] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.928331 1486 raft_consensus.cc:3037] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.929071 1486 raft_consensus.cc:2454] T 14a4c4ffcbd54a10b58312533628c560 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.929071 1563 raft_consensus.cc:2454] T 14a4c4ffcbd54a10b58312533628c560 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.929354 1602 leader_election.cc:302] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.929518 1802 raft_consensus.cc:2781] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.929605 1802 raft_consensus.cc:686] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.929704 1802 consensus_queue.cc:237] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.931248 1384 catalog_manager.cc:5484] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.932823 1686 raft_consensus.cc:482] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.932890 1686 raft_consensus.cc:504] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.933192 1686 leader_election.cc:288] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.933435 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480063e4cccc4173ad5a8d258ce204dc" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.933522 1637 raft_consensus.cc:2454] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.933682 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480063e4cccc4173ad5a8d258ce204dc" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.933784 1486 raft_consensus.cc:2454] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:25.933807 1528 leader_election.cc:302] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.933992 1686 raft_consensus.cc:2781] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.934046 1686 raft_consensus.cc:482] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.934083 1686 raft_consensus.cc:3037] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.934711 1686 raft_consensus.cc:504] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.934988 1686 leader_election.cc:288] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.935194 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480063e4cccc4173ad5a8d258ce204dc" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.935228 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480063e4cccc4173ad5a8d258ce204dc" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:25.935323 1637 raft_consensus.cc:3037] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.935328 1486 raft_consensus.cc:3037] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.936139 1486 raft_consensus.cc:2454] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.936139 1637 raft_consensus.cc:2454] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:25.936424 1529 leader_election.cc:302] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:25.936558 1686 raft_consensus.cc:2781] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.936627 1686 raft_consensus.cc:686] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:25.936738 1686 consensus_queue.cc:237] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.938373 1384 catalog_manager.cc:5484] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:25.943051 1802 raft_consensus.cc:482] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.943156 1802 raft_consensus.cc:504] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.943477 1802 leader_election.cc:288] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.943738 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd482dfb6e04b6f8d40ddd3a9f03367" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:25.943763 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd482dfb6e04b6f8d40ddd3a9f03367" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.943854 1486 raft_consensus.cc:2454] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.943876 1563 raft_consensus.cc:2454] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 0.
I20240503 08:01:25.944099 1602 leader_election.cc:302] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.944254 1697 raft_consensus.cc:2781] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:25.944309 1697 raft_consensus.cc:482] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:25.944348 1697 raft_consensus.cc:3037] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.944976 1802 consensus_queue.cc:1035] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.945191 1697 raft_consensus.cc:504] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.945501 1697 leader_election.cc:288] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:25.945782 1487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd482dfb6e04b6f8d40ddd3a9f03367" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:25.945832 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd482dfb6e04b6f8d40ddd3a9f03367" candidate_uuid: "9f870be2d05c49bbab11db8ad76d6c89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:25.945897 1487 raft_consensus.cc:3037] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.945897 1563 raft_consensus.cc:3037] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.946740 1563 raft_consensus.cc:2454] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.946740 1487 raft_consensus.cc:2454] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f870be2d05c49bbab11db8ad76d6c89 in term 1.
I20240503 08:01:25.947059 1604 leader_election.cc:302] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:25.947194 1710 raft_consensus.cc:2781] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:25.947263 1710 raft_consensus.cc:686] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Becoming Leader. State: Replica: 9f870be2d05c49bbab11db8ad76d6c89, State: Running, Role: LEADER
I20240503 08:01:25.947386 1710 consensus_queue.cc:237] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.948904 1802 consensus_queue.cc:1035] T 970a0c99cf944e55b89833ebb22db26b P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.949775 1384 catalog_manager.cc:5484] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3). New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } }
I20240503 08:01:25.953485 1689 raft_consensus.cc:482] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.953557 1689 raft_consensus.cc:504] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.953835 1689 leader_election.cc:288] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.954093 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea8e975a53347df9e925173aeebaf61" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.954097 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea8e975a53347df9e925173aeebaf61" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.954211 1637 raft_consensus.cc:2379] T fea8e975a53347df9e925173aeebaf61 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f4fcb24282e423cb788be167a3540e7 in current term 1: Already voted for candidate 171fd27a77964e6588327f262ecffc39 in this term.
I20240503 08:01:25.954422 1452 leader_election.cc:302] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7; no voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.954555 1689 raft_consensus.cc:3037] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.955224 1689 raft_consensus.cc:2726] T fea8e975a53347df9e925173aeebaf61 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.958722 1778 consensus_queue.cc:1035] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.959013 1689 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.959513 1689 consensus_queue.cc:1035] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.960594 1689 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.964399 1802 consensus_queue.cc:1035] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.965751 1686 consensus_queue.cc:1035] T 16cc735ddd4540ba9b3f9726c6a3e0a8 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.966588 1689 consensus_queue.cc:1035] T 966ebd7eb10c4aef85de0b17abcbf686 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.968830 1778 consensus_queue.cc:1035] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.968957 1710 consensus_queue.cc:1035] T 793b3b6ea5a84982beaf5207f13f8e0b P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.969076 1689 raft_consensus.cc:482] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.969156 1689 raft_consensus.cc:504] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.969547 1689 leader_election.cc:288] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.969797 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3127e54a030482ab724e240c2b00c72" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.969918 1638 raft_consensus.cc:2379] T c3127e54a030482ab724e240c2b00c72 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f4fcb24282e423cb788be167a3540e7 in current term 1: Already voted for candidate 171fd27a77964e6588327f262ecffc39 in this term.
I20240503 08:01:25.972127 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3127e54a030482ab724e240c2b00c72" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.972601 1689 raft_consensus.cc:482] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:25.972679 1689 raft_consensus.cc:504] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:25.973006 1689 leader_election.cc:288] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:25.973280 1451 leader_election.cc:302] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7; no voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.973404 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4576f5272c45089055f9f0d36db63c" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:25.973484 1689 raft_consensus.cc:3037] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.973560 1691 consensus_queue.cc:1035] T fea8e975a53347df9e925173aeebaf61 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.974481 1689 raft_consensus.cc:2726] T c3127e54a030482ab724e240c2b00c72 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.975222 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4576f5272c45089055f9f0d36db63c" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:25.975344 1638 raft_consensus.cc:2379] T 0d4576f5272c45089055f9f0d36db63c P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f4fcb24282e423cb788be167a3540e7 in current term 1: Already voted for candidate 171fd27a77964e6588327f262ecffc39 in this term.
I20240503 08:01:25.975651 1452 leader_election.cc:302] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7; no voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89
I20240503 08:01:25.975870 1685 raft_consensus.cc:3037] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:25.976862 1685 raft_consensus.cc:2726] T 0d4576f5272c45089055f9f0d36db63c P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:01:25.986886 1802 consensus_queue.cc:1035] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.989506 1697 consensus_queue.cc:1035] T 243ebc6725bc47faadf3e3a1c32a6859 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.991775 1697 consensus_queue.cc:1035] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.994197 1697 consensus_queue.cc:1035] T c52a1a85e18542c1b66458a67a9f79b7 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.995193 1961 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 08:01:25.997051 1691 consensus_queue.cc:1035] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:25.999066 1691 consensus_queue.cc:1035] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.001092 1686 consensus_queue.cc:1035] T 00be723293944a50ad14d0cb4b998fb5 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.003103 1961 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.005872 1686 consensus_queue.cc:1035] T c3127e54a030482ab724e240c2b00c72 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.008155 1697 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.010551 1697 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.011718 1697 consensus_queue.cc:1035] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.014369 1697 consensus_queue.cc:1035] T 293a1ffb916e457aacb4f84dae69cb32 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.021660 1710 consensus_queue.cc:1035] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.023883 1710 consensus_queue.cc:1035] T 2a89ecf63c0a4ebba117030ea7c82610 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.026096 1686 consensus_queue.cc:1035] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.028342 1778 consensus_queue.cc:1035] T 0d4576f5272c45089055f9f0d36db63c P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.036654 1778 raft_consensus.cc:482] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:26.036772 1778 raft_consensus.cc:504] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:26.037118 1778 leader_election.cc:288] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:26.037406 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ee17f54468471aaffac608f360a090" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:26.037410 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ee17f54468471aaffac608f360a090" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7" is_pre_election: true
I20240503 08:01:26.037519 1639 raft_consensus.cc:2454] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:26.037547 1486 raft_consensus.cc:2454] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 0.
I20240503 08:01:26.037726 1528 leader_election.cc:302] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:26.037943 1778 raft_consensus.cc:2781] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:26.038005 1778 raft_consensus.cc:482] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:26.038046 1778 raft_consensus.cc:3037] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:26.038774 1778 raft_consensus.cc:504] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:26.039067 1778 leader_election.cc:288] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Requested vote from peers 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:26.039369 1486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ee17f54468471aaffac608f360a090" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f4fcb24282e423cb788be167a3540e7"
I20240503 08:01:26.039501 1486 raft_consensus.cc:3037] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:26.040232 1486 raft_consensus.cc:2454] T 96ee17f54468471aaffac608f360a090 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:26.040432 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ee17f54468471aaffac608f360a090" candidate_uuid: "171fd27a77964e6588327f262ecffc39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:26.040485 1529 leader_election.cc:302] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:26.040532 1639 raft_consensus.cc:3037] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:26.040632 1778 raft_consensus.cc:2781] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:26.040695 1778 raft_consensus.cc:686] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Becoming Leader. State: Replica: 171fd27a77964e6588327f262ecffc39, State: Running, Role: LEADER
I20240503 08:01:26.040839 1778 consensus_queue.cc:237] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:26.041332 1639 raft_consensus.cc:2454] T 96ee17f54468471aaffac608f360a090 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 171fd27a77964e6588327f262ecffc39 in term 1.
I20240503 08:01:26.042586 1383 catalog_manager.cc:5484] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 171fd27a77964e6588327f262ecffc39 (127.0.99.2). New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:26.051781 1691 consensus_queue.cc:1035] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 08:01:26.052546 1434 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 08:01:26.054373 1686 consensus_queue.cc:1035] T 10154920cfd34910be91e017a7968233 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.068478 1961 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.068751 1686 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.071770 1778 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.072531 1746 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.072877 1778 consensus_queue.cc:1035] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.076673 1686 consensus_queue.cc:1035] T 39bf366ef12b4fe2bd8db5591267de67 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.079648 1772 consensus_queue.cc:1035] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.082396 1697 consensus_queue.cc:1035] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.093123 1686 consensus_queue.cc:1035] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.095347 1686 consensus_queue.cc:1035] T c219ee9b1aaf4c75a0581d9ea9fcc907 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.103075 1686 consensus_queue.cc:1035] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.105713 1691 consensus_queue.cc:1035] T 457808a6880d407a97940e0e5f87e46b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.109328 1710 consensus_queue.cc:1035] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.111527 1697 consensus_queue.cc:1035] T 2276ca9aefd240dca8eb751b715b6665 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.118299 1697 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.119527 1697 consensus_queue.cc:1035] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.119791 1710 consensus_queue.cc:1035] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.121137 1772 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.122437 1746 consensus_queue.cc:1035] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.123775 1772 consensus_queue.cc:1035] T a9277beceda64dc3af1f7d0ba9cf9249 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.127197 1746 consensus_queue.cc:1035] T 5af3e1b929d34152b04359d370772926 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.128584 1697 consensus_queue.cc:1035] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.143874 1746 raft_consensus.cc:482] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:01:26.144012 1746 raft_consensus.cc:504] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:26.144476 1746 leader_election.cc:288] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:26.144857 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bd5a282529408ebde35305325417ce" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39" is_pre_election: true
I20240503 08:01:26.144857 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bd5a282529408ebde35305325417ce" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89" is_pre_election: true
I20240503 08:01:26.145005 1562 raft_consensus.cc:2454] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:26.145044 1639 raft_consensus.cc:2454] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 0.
I20240503 08:01:26.145279 1451 leader_election.cc:302] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 171fd27a77964e6588327f262ecffc39, 8f4fcb24282e423cb788be167a3540e7; no voters:
I20240503 08:01:26.145460 1746 raft_consensus.cc:2781] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:01:26.145529 1746 raft_consensus.cc:482] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:01:26.145498 1691 consensus_queue.cc:1035] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.145574 1746 raft_consensus.cc:3037] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:26.146598 1746 raft_consensus.cc:504] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:26.146924 1746 leader_election.cc:288] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Requested vote from peers 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553), 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:26.147161 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bd5a282529408ebde35305325417ce" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f870be2d05c49bbab11db8ad76d6c89"
I20240503 08:01:26.147280 1639 raft_consensus.cc:3037] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:26.147719 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58bd5a282529408ebde35305325417ce" candidate_uuid: "8f4fcb24282e423cb788be167a3540e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "171fd27a77964e6588327f262ecffc39"
I20240503 08:01:26.147807 1562 raft_consensus.cc:3037] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:01:26.148206 1639 raft_consensus.cc:2454] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:26.148543 1452 leader_election.cc:302] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f4fcb24282e423cb788be167a3540e7, 9f870be2d05c49bbab11db8ad76d6c89; no voters:
I20240503 08:01:26.148710 1562 raft_consensus.cc:2454] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4fcb24282e423cb788be167a3540e7 in term 1.
I20240503 08:01:26.148909 1746 raft_consensus.cc:2781] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:01:26.148991 1746 raft_consensus.cc:686] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8f4fcb24282e423cb788be167a3540e7, State: Running, Role: LEADER
I20240503 08:01:26.149108 1746 consensus_queue.cc:237] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } }
I20240503 08:01:26.149766 1686 consensus_queue.cc:1035] T 56853fdbc6ab40bdbcf146d71a8d8c72 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.151641 1383 catalog_manager.cc:5484] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1). New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:26.177234 1697 consensus_queue.cc:1035] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.181435 1802 consensus_queue.cc:1035] T 12066e116ad446119c3e940a9ac37f12 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.185168 1686 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.187495 1686 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.187841 1802 consensus_queue.cc:1035] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.191666 1697 consensus_queue.cc:1035] T 509a9c384f4c448a9fb048e0d6ff8563 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.208120 1691 consensus_queue.cc:1035] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.210574 1691 consensus_queue.cc:1035] T 0285ac6e9f884a4abc7a272a664e2406 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.226894 1691 consensus_queue.cc:1035] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.229468 1778 consensus_queue.cc:1035] T 3d0156bfa7c8465d80d93ab1301a0e67 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.238270 1697 consensus_queue.cc:1035] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.240749 1802 consensus_queue.cc:1035] T 7091489ce2b94c82abd265d81c5e38d3 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.244693 1802 consensus_queue.cc:1035] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.247018 1697 consensus_queue.cc:1035] T e3937ed53708473da219f5847f26a99d P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.273908 1746 consensus_queue.cc:1035] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.277053 1778 consensus_queue.cc:1035] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.278127 1961 consensus_queue.cc:1035] T 9a3ab6ff3aec423da20f2a55a038c5b2 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.279654 1746 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.280040 1691 consensus_queue.cc:1035] T 5e7cc8dc5aae46b3903508c4060666d7 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.282311 1685 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.286350 1691 consensus_queue.cc:1035] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.288759 1691 consensus_queue.cc:1035] T 32dcb8f792b747eeb0bcb0e3bec65e42 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.300599 396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:01:26.303031 1697 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 08:01:26.303349 2037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:01:26.304023 2038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:26.304674 396 server_base.cc:1034] running on GCE node
W20240503 08:01:26.305867 2040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:01:26.306171 396 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:01:26.306216 396 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:01:26.306236 396 hybrid_clock.cc:648] HybridClock initialized: now 1714723286306236 us; error 0 us; skew 500 ppm
I20240503 08:01:26.307103 1772 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.312309 396 webserver.cc:460] Webserver started at http://127.0.99.4:40531/ using document root <none> and password file <none>
I20240503 08:01:26.312335 1961 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.312510 396 fs_manager.cc:359] Metadata directory not provided
I20240503 08:01:26.312490 1685 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.312584 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:01:26.312664 396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:01:26.313099 396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-3-root/instance:
uuid: "75aca704dc1c4b008958c9229a0bda65"
format_stamp: "Formatted at 2024-05-03 08:01:26 on dist-test-slave-gf01"
I20240503 08:01:26.315784 396 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20240503 08:01:26.317153 2049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:26.317443 396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:26.317509 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-3-root
uuid: "75aca704dc1c4b008958c9229a0bda65"
format_stamp: "Formatted at 2024-05-03 08:01:26 on dist-test-slave-gf01"
I20240503 08:01:26.317565 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:01:26.341373 1772 consensus_queue.cc:1035] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.344116 1802 consensus_queue.cc:1035] T 14a4c4ffcbd54a10b58312533628c560 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.350100 396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:01:26.350414 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:01:26.350656 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:01:26.351063 396 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:01:26.351099 396 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:26.351142 396 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:01:26.351168 396 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:01:26.355088 1686 consensus_queue.cc:1035] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.356273 396 rpc_server.cc:307] RPC server started. Bound to: 127.0.99.4:45553
I20240503 08:01:26.356316 2115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.99.4:45553 every 8 connection(s)
I20240503 08:01:26.356745 396 auto_leader_rebalancer-test.cc:405] add a tserver: 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:26.358455 1691 consensus_queue.cc:1035] T 9a3745831794490b9318a7ba5e65c505 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.383829 2116 heartbeater.cc:347] Connected to a master server at 127.0.99.62:36027
I20240503 08:01:26.383946 2116 heartbeater.cc:464] Registering TS with master...
I20240503 08:01:26.384164 2116 heartbeater.cc:511] Master 127.0.99.62:36027 requested a full tablet report, sending...
I20240503 08:01:26.384780 1383 ts_manager.cc:194] Registered new tserver with Master: 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553)
I20240503 08:01:26.385318 1383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39828
I20240503 08:01:26.411409 1686 consensus_queue.cc:1035] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.414261 1691 consensus_queue.cc:1035] T 71ba268c9b4c4e059c86d3804eb9513d P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.418460 1685 consensus_queue.cc:1035] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.421645 1689 consensus_queue.cc:1035] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.444481 1697 consensus_queue.cc:1035] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.447461 1802 consensus_queue.cc:1035] T 1bd482dfb6e04b6f8d40ddd3a9f03367 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.466195 1686 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.469583 1686 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.603854 1686 consensus_queue.cc:1035] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.606585 1691 consensus_queue.cc:1035] T 96ee17f54468471aaffac608f360a090 P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.710148 1685 consensus_queue.cc:1035] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:26.712730 1961 consensus_queue.cc:1035] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:01:27.067234 1562 consensus_queue.cc:237] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.069054 1486 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.069317 1639 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.069422 1691 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.069619 1778 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.071117 2129 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.071522 1639 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.071600 1488 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.074007 1385 catalog_manager.cc:5484] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
W20240503 08:01:27.074930 1528 consensus_peers.cc:485] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c436d20ad34f455ea1ac00e72e2118fd. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:27.078248 1639 consensus_queue.cc:237] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.079371 1562 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.079689 1488 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.079854 1697 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.080587 1697 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.081204 1802 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.081537 1562 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
W20240503 08:01:27.083073 1603 consensus_peers.cc:485] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f4e300297e84663bcb1b718bfe537ce. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:27.083853 1488 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.083956 1384 catalog_manager.cc:5484] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.087939 1488 consensus_queue.cc:237] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.089243 1562 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.089270 1639 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.089593 1685 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.089848 1961 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.091037 1685 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.091630 1639 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.091670 1562 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
W20240503 08:01:27.093257 1452 consensus_peers.cc:485] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a053f3bfd984b82b2d6ea6e833e2245. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:27.093852 1383 catalog_manager.cc:5484] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.094494 1639 consensus_queue.cc:237] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.095660 1562 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.095834 1488 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:27.095990 1802 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:27.096273 1697 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:01:27.096426 1603 consensus_peers.cc:485] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3c8c6ca18ca47d18e3650e09dac28cc. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:27.097465 1710 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.097919 1563 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.098500 1488 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.100589 1384 catalog_manager.cc:5484] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:27.386142 2116 heartbeater.cc:503] Master 127.0.99.62:36027 was elected leader, sending a full tablet report...
I20240503 08:01:27.530697 2148 ts_tablet_manager.cc:902] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:27.531538 2148 tablet_copy_client.cc:308] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.1:34409
I20240503 08:01:27.536770 1498 tablet_copy_service.cc:140] P 8f4fcb24282e423cb788be167a3540e7: Received BeginTabletCopySession request for tablet 9a053f3bfd984b82b2d6ea6e833e2245 from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:53416)
I20240503 08:01:27.536931 1498 tablet_copy_service.cc:161] P 8f4fcb24282e423cb788be167a3540e7: Beginning new tablet copy session on tablet 9a053f3bfd984b82b2d6ea6e833e2245 from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:53416: session id = 75aca704dc1c4b008958c9229a0bda65-9a053f3bfd984b82b2d6ea6e833e2245
I20240503 08:01:27.538453 1498 tablet_copy_source_session.cc:205] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:27.539757 2148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a053f3bfd984b82b2d6ea6e833e2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:27.541981 2148 tablet_copy_client.cc:783] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:27.542155 2148 tablet_copy_client.cc:647] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:27.543488 2148 tablet_copy_client.cc:523] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:27.544904 2148 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:27.549469 2148 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:27.549733 2148 tablet_bootstrap.cc:492] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:27.549882 2148 ts_tablet_manager.cc:1367] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20240503 08:01:27.550315 2148 raft_consensus.cc:348] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.550446 2148 raft_consensus.cc:729] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:27.550544 2148 consensus_queue.cc:260] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.550889 2148 ts_tablet_manager.cc:1398] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.002s sys 0.001s
I20240503 08:01:27.551368 1498 tablet_copy_service.cc:342] P 8f4fcb24282e423cb788be167a3540e7: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-9a053f3bfd984b82b2d6ea6e833e2245 received from {username='slave'} at 127.0.0.1:53416
I20240503 08:01:27.551468 1498 tablet_copy_service.cc:433] P 8f4fcb24282e423cb788be167a3540e7: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-9a053f3bfd984b82b2d6ea6e833e2245 on tablet 9a053f3bfd984b82b2d6ea6e833e2245 with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:27.556988 2148 ts_tablet_manager.cc:902] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:27.557447 2148 tablet_copy_client.cc:308] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.2:41553
I20240503 08:01:27.561482 1574 tablet_copy_service.cc:140] P 171fd27a77964e6588327f262ecffc39: Received BeginTabletCopySession request for tablet c436d20ad34f455ea1ac00e72e2118fd from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:48218)
I20240503 08:01:27.561594 1574 tablet_copy_service.cc:161] P 171fd27a77964e6588327f262ecffc39: Beginning new tablet copy session on tablet c436d20ad34f455ea1ac00e72e2118fd from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:48218: session id = 75aca704dc1c4b008958c9229a0bda65-c436d20ad34f455ea1ac00e72e2118fd
I20240503 08:01:27.562657 1574 tablet_copy_source_session.cc:205] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:27.563413 2148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c436d20ad34f455ea1ac00e72e2118fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:27.565472 2148 tablet_copy_client.cc:783] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:27.565615 2148 tablet_copy_client.cc:647] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:27.566579 2148 tablet_copy_client.cc:523] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:27.567742 2148 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:27.570988 2148 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:27.571213 2148 tablet_bootstrap.cc:492] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:27.571369 2148 ts_tablet_manager.cc:1367] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:27.571805 2148 raft_consensus.cc:348] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.571910 2148 raft_consensus.cc:729] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:27.572010 2148 consensus_queue.cc:260] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.572260 2148 ts_tablet_manager.cc:1398] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:27.573052 1574 tablet_copy_service.cc:342] P 171fd27a77964e6588327f262ecffc39: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-c436d20ad34f455ea1ac00e72e2118fd received from {username='slave'} at 127.0.0.1:48218
I20240503 08:01:27.573119 1574 tablet_copy_service.cc:433] P 171fd27a77964e6588327f262ecffc39: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-c436d20ad34f455ea1ac00e72e2118fd on tablet c436d20ad34f455ea1ac00e72e2118fd with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:27.573877 2161 ts_tablet_manager.cc:902] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:27.574350 2161 tablet_copy_client.cc:308] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.3:37627
I20240503 08:01:27.577730 1649 tablet_copy_service.cc:140] P 9f870be2d05c49bbab11db8ad76d6c89: Received BeginTabletCopySession request for tablet 5f4e300297e84663bcb1b718bfe537ce from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:47730)
I20240503 08:01:27.577824 1649 tablet_copy_service.cc:161] P 9f870be2d05c49bbab11db8ad76d6c89: Beginning new tablet copy session on tablet 5f4e300297e84663bcb1b718bfe537ce from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:47730: session id = 75aca704dc1c4b008958c9229a0bda65-5f4e300297e84663bcb1b718bfe537ce
I20240503 08:01:27.578720 1649 tablet_copy_source_session.cc:205] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:27.579521 2161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4e300297e84663bcb1b718bfe537ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:27.581387 2161 tablet_copy_client.cc:783] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:27.581554 2161 tablet_copy_client.cc:647] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:27.582566 2161 tablet_copy_client.cc:523] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:27.583783 2161 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:27.586966 2161 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:27.587188 2161 tablet_bootstrap.cc:492] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:27.587337 2161 ts_tablet_manager.cc:1367] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:27.587797 2161 raft_consensus.cc:348] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.587920 2161 raft_consensus.cc:729] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:27.588016 2161 consensus_queue.cc:260] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.588719 2161 ts_tablet_manager.cc:1398] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240503 08:01:27.589351 1649 tablet_copy_service.cc:342] P 9f870be2d05c49bbab11db8ad76d6c89: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-5f4e300297e84663bcb1b718bfe537ce received from {username='slave'} at 127.0.0.1:47730
I20240503 08:01:27.589434 1649 tablet_copy_service.cc:433] P 9f870be2d05c49bbab11db8ad76d6c89: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-5f4e300297e84663bcb1b718bfe537ce on tablet 5f4e300297e84663bcb1b718bfe537ce with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:27.703195 2161 ts_tablet_manager.cc:902] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:27.703812 2161 tablet_copy_client.cc:308] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.3:37627
I20240503 08:01:27.704205 1649 tablet_copy_service.cc:140] P 9f870be2d05c49bbab11db8ad76d6c89: Received BeginTabletCopySession request for tablet d3c8c6ca18ca47d18e3650e09dac28cc from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:47730)
I20240503 08:01:27.704299 1649 tablet_copy_service.cc:161] P 9f870be2d05c49bbab11db8ad76d6c89: Beginning new tablet copy session on tablet d3c8c6ca18ca47d18e3650e09dac28cc from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:47730: session id = 75aca704dc1c4b008958c9229a0bda65-d3c8c6ca18ca47d18e3650e09dac28cc
I20240503 08:01:27.705253 1649 tablet_copy_source_session.cc:205] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:27.705986 2161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c8c6ca18ca47d18e3650e09dac28cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:27.708112 2161 tablet_copy_client.cc:783] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:27.708262 2161 tablet_copy_client.cc:647] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:27.709475 2161 tablet_copy_client.cc:523] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:27.710512 2161 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:27.713603 2161 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:27.713819 2161 tablet_bootstrap.cc:492] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:27.713979 2161 ts_tablet_manager.cc:1367] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:01:27.714375 2161 raft_consensus.cc:348] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.714501 2161 raft_consensus.cc:729] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:27.714601 2161 consensus_queue.cc:260] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:27.714869 2161 ts_tablet_manager.cc:1398] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:27.715226 1649 tablet_copy_service.cc:342] P 9f870be2d05c49bbab11db8ad76d6c89: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-d3c8c6ca18ca47d18e3650e09dac28cc received from {username='slave'} at 127.0.0.1:47730
I20240503 08:01:27.715286 1649 tablet_copy_service.cc:433] P 9f870be2d05c49bbab11db8ad76d6c89: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-d3c8c6ca18ca47d18e3650e09dac28cc on tablet d3c8c6ca18ca47d18e3650e09dac28cc with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:27.912986 2089 raft_consensus.cc:1203] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:27.999959 2089 raft_consensus.cc:1203] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:28.158797 2089 raft_consensus.cc:1203] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:28.288816 2089 raft_consensus.cc:1203] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:28.409116 1802 raft_consensus.cc:1050] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:28.409631 1802 consensus_queue.cc:237] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.410943 2089 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.410943 1486 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.411092 1563 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.411342 2176 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.411557 2173 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.411727 1710 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.414286 1802 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.414577 2089 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.415968 1563 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.416867 1383 catalog_manager.cc:5484] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.417665 1486 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.422811 1639 consensus_queue.cc:237] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.423785 2089 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.423942 1563 raft_consensus.cc:1261] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.424398 1710 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.424685 1710 consensus_queue.cc:1035] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.425747 1802 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.426496 2089 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.426988 1370 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5f4e300297e84663bcb1b718bfe537ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:28.428470 1382 catalog_manager.cc:5484] T 5f4e300297e84663bcb1b718bfe537ce P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.430037 1563 raft_consensus.cc:2932] T 5f4e300297e84663bcb1b718bfe537ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.430729 1472 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f4e300297e84663bcb1b718bfe537ce with delete_type TABLET_DATA_TOMBSTONED (TS 8f4fcb24282e423cb788be167a3540e7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53376
I20240503 08:01:28.431341 2184 tablet_replica.cc:330] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: stopping tablet replica
I20240503 08:01:28.431511 2184 raft_consensus.cc:2229] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:28.431892 2184 raft_consensus.cc:2258] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:28.432986 2184 ts_tablet_manager.cc:1875] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:28.434932 2184 ts_tablet_manager.cc:1888] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:28.435010 2184 log.cc:1196] T 5f4e300297e84663bcb1b718bfe537ce P 8f4fcb24282e423cb788be167a3540e7: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root/wals/5f4e300297e84663bcb1b718bfe537ce
I20240503 08:01:28.435526 1371 catalog_manager.cc:4830] TS 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): tablet 5f4e300297e84663bcb1b718bfe537ce (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:28.501346 1689 raft_consensus.cc:1050] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:28.501773 1689 consensus_queue.cc:237] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.503262 2089 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.503310 1562 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.503333 1639 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.503700 2187 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.503904 2188 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.504065 2185 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.506366 2187 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.506664 1639 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.508354 2089 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.508433 1563 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.510020 1382 catalog_manager.cc:5484] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.513871 1486 consensus_queue.cc:237] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.514690 2089 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.514734 1638 raft_consensus.cc:1261] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.515022 2187 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.515202 2188 consensus_queue.cc:1035] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.516500 2188 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.516808 1638 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.517913 1371 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9a053f3bfd984b82b2d6ea6e833e2245 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:28.518219 2089 raft_consensus.cc:2932] T 9a053f3bfd984b82b2d6ea6e833e2245 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.518833 1384 catalog_manager.cc:5484] T 9a053f3bfd984b82b2d6ea6e833e2245 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:28.521631 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a053f3bfd984b82b2d6ea6e833e2245 with delete_type TABLET_DATA_TOMBSTONED (TS 171fd27a77964e6588327f262ecffc39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48176
I20240503 08:01:28.521982 2192 tablet_replica.cc:330] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: stopping tablet replica
I20240503 08:01:28.522107 2192 raft_consensus.cc:2229] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:28.522209 2192 raft_consensus.cc:2258] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:28.522727 2192 ts_tablet_manager.cc:1875] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:28.524423 2192 ts_tablet_manager.cc:1888] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:28.524480 2192 log.cc:1196] T 9a053f3bfd984b82b2d6ea6e833e2245 P 171fd27a77964e6588327f262ecffc39: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root/wals/9a053f3bfd984b82b2d6ea6e833e2245
I20240503 08:01:28.524955 1369 catalog_manager.cc:4830] TS 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553): tablet 9a053f3bfd984b82b2d6ea6e833e2245 (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:28.706727 2174 raft_consensus.cc:1050] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:28.707182 2174 consensus_queue.cc:237] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.708403 1638 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.708403 2089 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.708526 1486 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.708966 2195 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.709354 1691 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.709566 2174 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.711727 1691 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.712003 1639 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.712021 2089 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.713352 1486 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.714339 1383 catalog_manager.cc:5484] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.718797 1562 consensus_queue.cc:237] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.720000 2089 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.720001 1486 raft_consensus.cc:1261] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.720429 2194 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.720608 2195 consensus_queue.cc:1035] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.722124 2195 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.722350 1486 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.722976 2089 raft_consensus.cc:2932] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.723603 1369 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet c436d20ad34f455ea1ac00e72e2118fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:28.725087 1384 catalog_manager.cc:5484] T c436d20ad34f455ea1ac00e72e2118fd P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.727720 1629 tablet_service.cc:1514] Processing DeleteTablet for tablet c436d20ad34f455ea1ac00e72e2118fd with delete_type TABLET_DATA_TOMBSTONED (TS 9f870be2d05c49bbab11db8ad76d6c89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47706
I20240503 08:01:28.728119 2199 tablet_replica.cc:330] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: stopping tablet replica
I20240503 08:01:28.728264 2199 raft_consensus.cc:2229] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:28.728416 2199 raft_consensus.cc:2258] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:28.729132 2199 ts_tablet_manager.cc:1875] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:28.731009 2199 ts_tablet_manager.cc:1888] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:28.731083 2199 log.cc:1196] T c436d20ad34f455ea1ac00e72e2118fd P 9f870be2d05c49bbab11db8ad76d6c89: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root/wals/c436d20ad34f455ea1ac00e72e2118fd
I20240503 08:01:28.731578 1370 catalog_manager.cc:4830] TS 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): tablet c436d20ad34f455ea1ac00e72e2118fd (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:28.832806 1710 raft_consensus.cc:1050] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:28.833195 1710 consensus_queue.cc:237] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.834574 1486 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.834813 1562 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.835137 1710 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.835357 1802 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.835482 2089 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:28.836371 1802 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:28.837754 1710 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.838003 1486 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.838773 2089 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.839577 1562 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.841029 1385 catalog_manager.cc:5484] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.843624 1638 consensus_queue.cc:237] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:28.844640 2089 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.844909 1486 raft_consensus.cc:1261] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:28.844938 2173 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.845503 2173 consensus_queue.cc:1035] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:28.846402 2176 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.847270 1486 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.847908 1370 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d3c8c6ca18ca47d18e3650e09dac28cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:28.847890 2089 raft_consensus.cc:2932] T d3c8c6ca18ca47d18e3650e09dac28cc P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:28.849844 1383 catalog_manager.cc:5484] T d3c8c6ca18ca47d18e3650e09dac28cc P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:28.851925 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet d3c8c6ca18ca47d18e3650e09dac28cc with delete_type TABLET_DATA_TOMBSTONED (TS 171fd27a77964e6588327f262ecffc39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48176
I20240503 08:01:28.852123 2192 tablet_replica.cc:330] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: stopping tablet replica
I20240503 08:01:28.852262 2192 raft_consensus.cc:2229] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:28.852396 2192 raft_consensus.cc:2258] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:28.852892 2192 ts_tablet_manager.cc:1875] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:28.854499 2192 ts_tablet_manager.cc:1888] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:28.854554 2192 log.cc:1196] T d3c8c6ca18ca47d18e3650e09dac28cc P 171fd27a77964e6588327f262ecffc39: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root/wals/d3c8c6ca18ca47d18e3650e09dac28cc
I20240503 08:01:28.854916 1369 catalog_manager.cc:4830] TS 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553): tablet d3c8c6ca18ca47d18e3650e09dac28cc (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:29.859138 1488 consensus_queue.cc:237] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:29.860702 1639 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.860702 1562 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:01:29.860783 1452 consensus_peers.cc:485] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8545dc5db5dd48fea2116afe19dd17c1. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:29.861205 2185 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.861375 2205 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.862941 2205 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.863497 1639 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.865921 1562 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.866344 1384 catalog_manager.cc:5484] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.869470 1562 consensus_queue.cc:237] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
W20240503 08:01:29.870862 1528 consensus_peers.cc:485] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a64a657fff614834aabcb06e2197030b. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:29.870976 1639 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.871245 2195 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.871492 1488 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.872136 2195 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.873070 1691 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.873498 1639 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.874280 1488 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.875566 1486 consensus_queue.cc:237] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:29.875805 1383 catalog_manager.cc:5484] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240503 08:01:29.877147 1452 consensus_peers.cc:485] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 351717c2aada4ff691742452820f96f6. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:29.877317 1638 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.877445 1562 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.877748 2210 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.877914 2185 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.880337 2185 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.880800 1639 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.880885 1562 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.882653 1638 consensus_queue.cc:237] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:29.883301 1384 catalog_manager.cc:5484] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.883986 1488 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.884138 1562 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:29.884457 1710 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:01:29.884655 1603 consensus_peers.cc:485] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 907a3bdbd3454c4b8381fd68330bc2a0. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:29.884750 2173 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:29.886515 2221 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.886822 1562 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.886906 1488 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:29.890043 1384 catalog_manager.cc:5484] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:30.403744 2227 ts_tablet_manager.cc:902] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:30.404276 2227 tablet_copy_client.cc:308] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.1:34409
I20240503 08:01:30.404618 1498 tablet_copy_service.cc:140] P 8f4fcb24282e423cb788be167a3540e7: Received BeginTabletCopySession request for tablet 8545dc5db5dd48fea2116afe19dd17c1 from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:53416)
I20240503 08:01:30.404714 1498 tablet_copy_service.cc:161] P 8f4fcb24282e423cb788be167a3540e7: Beginning new tablet copy session on tablet 8545dc5db5dd48fea2116afe19dd17c1 from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:53416: session id = 75aca704dc1c4b008958c9229a0bda65-8545dc5db5dd48fea2116afe19dd17c1
I20240503 08:01:30.405493 1498 tablet_copy_source_session.cc:205] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:30.406213 2227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8545dc5db5dd48fea2116afe19dd17c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:30.408284 2227 tablet_copy_client.cc:783] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:30.408437 2227 tablet_copy_client.cc:647] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:30.409322 2227 tablet_copy_client.cc:523] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:30.410408 2227 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:30.413959 2227 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:30.414314 2227 tablet_bootstrap.cc:492] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:30.414470 2227 ts_tablet_manager.cc:1367] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.004s
I20240503 08:01:30.414899 2227 raft_consensus.cc:348] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.414999 2227 raft_consensus.cc:729] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:30.415095 2227 consensus_queue.cc:260] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.415632 2227 ts_tablet_manager.cc:1398] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:30.416126 1498 tablet_copy_service.cc:342] P 8f4fcb24282e423cb788be167a3540e7: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-8545dc5db5dd48fea2116afe19dd17c1 received from {username='slave'} at 127.0.0.1:53416
I20240503 08:01:30.416186 1498 tablet_copy_service.cc:433] P 8f4fcb24282e423cb788be167a3540e7: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-8545dc5db5dd48fea2116afe19dd17c1 on tablet 8545dc5db5dd48fea2116afe19dd17c1 with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:30.416502 2234 ts_tablet_manager.cc:902] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
I20240503 08:01:30.417040 2234 tablet_copy_client.cc:308] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.3:37627
I20240503 08:01:30.417780 1649 tablet_copy_service.cc:140] P 9f870be2d05c49bbab11db8ad76d6c89: Received BeginTabletCopySession request for tablet 907a3bdbd3454c4b8381fd68330bc2a0 from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:47730)
I20240503 08:01:30.417868 1649 tablet_copy_service.cc:161] P 9f870be2d05c49bbab11db8ad76d6c89: Beginning new tablet copy session on tablet 907a3bdbd3454c4b8381fd68330bc2a0 from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:47730: session id = 75aca704dc1c4b008958c9229a0bda65-907a3bdbd3454c4b8381fd68330bc2a0
I20240503 08:01:30.418622 1649 tablet_copy_source_session.cc:205] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:30.419356 2234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 907a3bdbd3454c4b8381fd68330bc2a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:30.421363 2234 tablet_copy_client.cc:783] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:30.421501 2234 tablet_copy_client.cc:647] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:30.422561 2234 tablet_copy_client.cc:523] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:30.423763 2234 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:30.427073 2234 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:30.427292 2234 tablet_bootstrap.cc:492] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:30.427475 2234 ts_tablet_manager.cc:1367] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:01:30.427918 2234 raft_consensus.cc:348] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.428056 2234 raft_consensus.cc:729] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:30.428156 2234 consensus_queue.cc:260] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.428457 2234 ts_tablet_manager.cc:1398] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:01:30.428853 1649 tablet_copy_service.cc:342] P 9f870be2d05c49bbab11db8ad76d6c89: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-907a3bdbd3454c4b8381fd68330bc2a0 received from {username='slave'} at 127.0.0.1:47730
I20240503 08:01:30.428918 1649 tablet_copy_service.cc:433] P 9f870be2d05c49bbab11db8ad76d6c89: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-907a3bdbd3454c4b8381fd68330bc2a0 on tablet 907a3bdbd3454c4b8381fd68330bc2a0 with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:30.446444 2234 ts_tablet_manager.cc:902] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:30.446929 2234 tablet_copy_client.cc:308] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.2:41553
I20240503 08:01:30.447340 1574 tablet_copy_service.cc:140] P 171fd27a77964e6588327f262ecffc39: Received BeginTabletCopySession request for tablet a64a657fff614834aabcb06e2197030b from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:48218)
I20240503 08:01:30.447458 1574 tablet_copy_service.cc:161] P 171fd27a77964e6588327f262ecffc39: Beginning new tablet copy session on tablet a64a657fff614834aabcb06e2197030b from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:48218: session id = 75aca704dc1c4b008958c9229a0bda65-a64a657fff614834aabcb06e2197030b
I20240503 08:01:30.448407 1574 tablet_copy_source_session.cc:205] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:30.449151 2234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64a657fff614834aabcb06e2197030b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:30.451211 2234 tablet_copy_client.cc:783] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:30.451360 2234 tablet_copy_client.cc:647] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:30.452419 2234 tablet_copy_client.cc:523] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:30.453555 2234 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:30.457140 2234 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:30.457350 2234 tablet_bootstrap.cc:492] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:30.457515 2234 ts_tablet_manager.cc:1367] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:01:30.457942 2234 raft_consensus.cc:348] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.458071 2234 raft_consensus.cc:729] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:30.458173 2234 consensus_queue.cc:260] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.458526 2234 ts_tablet_manager.cc:1398] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:01:30.458907 1574 tablet_copy_service.cc:342] P 171fd27a77964e6588327f262ecffc39: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-a64a657fff614834aabcb06e2197030b received from {username='slave'} at 127.0.0.1:48218
I20240503 08:01:30.458977 1574 tablet_copy_service.cc:433] P 171fd27a77964e6588327f262ecffc39: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-a64a657fff614834aabcb06e2197030b on tablet a64a657fff614834aabcb06e2197030b with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:30.472885 2234 ts_tablet_manager.cc:902] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:30.473372 2234 tablet_copy_client.cc:308] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.1:34409
I20240503 08:01:30.473716 1498 tablet_copy_service.cc:140] P 8f4fcb24282e423cb788be167a3540e7: Received BeginTabletCopySession request for tablet 351717c2aada4ff691742452820f96f6 from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:53416)
I20240503 08:01:30.473800 1498 tablet_copy_service.cc:161] P 8f4fcb24282e423cb788be167a3540e7: Beginning new tablet copy session on tablet 351717c2aada4ff691742452820f96f6 from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:53416: session id = 75aca704dc1c4b008958c9229a0bda65-351717c2aada4ff691742452820f96f6
I20240503 08:01:30.474761 1498 tablet_copy_source_session.cc:205] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:30.475533 2234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351717c2aada4ff691742452820f96f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:30.477572 2234 tablet_copy_client.cc:783] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:30.477717 2234 tablet_copy_client.cc:647] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:30.478627 2234 tablet_copy_client.cc:523] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:30.479732 2234 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:30.482997 2234 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:30.483211 2234 tablet_bootstrap.cc:492] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:30.483369 2234 ts_tablet_manager.cc:1367] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:01:30.483866 2234 raft_consensus.cc:348] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.483991 2234 raft_consensus.cc:729] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:30.484089 2234 consensus_queue.cc:260] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:30.484365 2234 ts_tablet_manager.cc:1398] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:01:30.484756 1498 tablet_copy_service.cc:342] P 8f4fcb24282e423cb788be167a3540e7: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-351717c2aada4ff691742452820f96f6 received from {username='slave'} at 127.0.0.1:53416
I20240503 08:01:30.484829 1498 tablet_copy_service.cc:433] P 8f4fcb24282e423cb788be167a3540e7: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-351717c2aada4ff691742452820f96f6 on tablet 351717c2aada4ff691742452820f96f6 with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:30.875376 2089 raft_consensus.cc:1203] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:30.907542 2089 raft_consensus.cc:1203] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:30.909459 2089 raft_consensus.cc:1203] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:31.028111 2089 raft_consensus.cc:1203] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:31.294514 2251 raft_consensus.cc:1050] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:31.294975 2251 consensus_queue.cc:237] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.296205 2089 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.296233 1637 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.296587 2195 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.296936 2195 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.296646 1488 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.297484 2256 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.298796 2195 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.299273 1637 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.301273 1488 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.301859 1383 catalog_manager.cc:5484] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.303313 2089 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.307543 1563 consensus_queue.cc:237] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.308507 1637 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.308799 2089 raft_consensus.cc:1261] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.308869 2251 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.309073 1691 consensus_queue.cc:1035] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.310803 2256 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.311635 2089 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.312641 1639 raft_consensus.cc:2932] T a64a657fff614834aabcb06e2197030b P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.313289 1369 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a64a657fff614834aabcb06e2197030b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:31.314356 1382 catalog_manager.cc:5484] T a64a657fff614834aabcb06e2197030b P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.316617 1472 tablet_service.cc:1514] Processing DeleteTablet for tablet a64a657fff614834aabcb06e2197030b with delete_type TABLET_DATA_TOMBSTONED (TS 8f4fcb24282e423cb788be167a3540e7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53376
I20240503 08:01:31.316979 2264 tablet_replica.cc:330] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: stopping tablet replica
I20240503 08:01:31.317096 2264 raft_consensus.cc:2229] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:31.317332 2264 raft_consensus.cc:2258] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:31.318099 2264 ts_tablet_manager.cc:1875] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:31.320114 2264 ts_tablet_manager.cc:1888] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:31.320180 2264 log.cc:1196] T a64a657fff614834aabcb06e2197030b P 8f4fcb24282e423cb788be167a3540e7: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root/wals/a64a657fff614834aabcb06e2197030b
I20240503 08:01:31.320595 1371 catalog_manager.cc:4830] TS 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): tablet a64a657fff614834aabcb06e2197030b (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:31.383605 2252 raft_consensus.cc:1050] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:31.383993 2252 consensus_queue.cc:237] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.385185 2089 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.385193 1637 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.385303 1563 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.385612 2252 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.385790 2266 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.385958 2253 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.388707 2253 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.390328 2089 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.390623 1637 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.390929 1563 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.392313 1384 catalog_manager.cc:5484] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:31.394758 1488 consensus_queue.cc:237] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.395826 1562 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.395967 2089 raft_consensus.cc:1261] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.396181 2266 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.396864 2252 consensus_queue.cc:1035] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.397676 2266 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.398633 2089 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.399016 1563 raft_consensus.cc:2932] T 8545dc5db5dd48fea2116afe19dd17c1 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.399246 1371 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8545dc5db5dd48fea2116afe19dd17c1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:31.401181 1383 catalog_manager.cc:5484] T 8545dc5db5dd48fea2116afe19dd17c1 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:31.403316 1629 tablet_service.cc:1514] Processing DeleteTablet for tablet 8545dc5db5dd48fea2116afe19dd17c1 with delete_type TABLET_DATA_TOMBSTONED (TS 9f870be2d05c49bbab11db8ad76d6c89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47706
I20240503 08:01:31.403712 2270 tablet_replica.cc:330] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: stopping tablet replica
I20240503 08:01:31.403940 2270 raft_consensus.cc:2229] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:31.404090 2270 raft_consensus.cc:2258] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:31.404729 2270 ts_tablet_manager.cc:1875] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:31.406675 2270 ts_tablet_manager.cc:1888] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:31.406735 2270 log.cc:1196] T 8545dc5db5dd48fea2116afe19dd17c1 P 9f870be2d05c49bbab11db8ad76d6c89: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root/wals/8545dc5db5dd48fea2116afe19dd17c1
I20240503 08:01:31.407188 1370 catalog_manager.cc:4830] TS 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): tablet 8545dc5db5dd48fea2116afe19dd17c1 (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:31.420445 2250 raft_consensus.cc:1050] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:31.420866 2250 consensus_queue.cc:237] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.422158 2089 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.422147 1563 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.422147 1488 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.422600 2272 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.422799 2254 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.422955 2224 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.424580 2224 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.425966 2089 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.426648 1563 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.428051 1488 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.428350 1385 catalog_manager.cc:5484] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.431290 1639 consensus_queue.cc:237] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.432238 2089 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.432420 1563 raft_consensus.cc:1261] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.432512 2250 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.432921 2250 consensus_queue.cc:1035] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.433818 2224 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.434185 2089 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.435402 1370 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 907a3bdbd3454c4b8381fd68330bc2a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:31.435822 1562 raft_consensus.cc:2932] T 907a3bdbd3454c4b8381fd68330bc2a0 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.436182 1385 catalog_manager.cc:5484] T 907a3bdbd3454c4b8381fd68330bc2a0 P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.438736 1472 tablet_service.cc:1514] Processing DeleteTablet for tablet 907a3bdbd3454c4b8381fd68330bc2a0 with delete_type TABLET_DATA_TOMBSTONED (TS 8f4fcb24282e423cb788be167a3540e7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53376
I20240503 08:01:31.438930 2264 tablet_replica.cc:330] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: stopping tablet replica
I20240503 08:01:31.439064 2264 raft_consensus.cc:2229] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:31.439181 2264 raft_consensus.cc:2258] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:31.439700 2264 ts_tablet_manager.cc:1875] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:31.441432 2264 ts_tablet_manager.cc:1888] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:31.441489 2264 log.cc:1196] T 907a3bdbd3454c4b8381fd68330bc2a0 P 8f4fcb24282e423cb788be167a3540e7: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root/wals/907a3bdbd3454c4b8381fd68330bc2a0
I20240503 08:01:31.441895 1371 catalog_manager.cc:4830] TS 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): tablet 907a3bdbd3454c4b8381fd68330bc2a0 (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:31.506076 2252 raft_consensus.cc:1050] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:31.506507 2252 consensus_queue.cc:237] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.507707 1563 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.507782 1639 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.507984 2089 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:31.508152 2266 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.508350 2252 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.508491 2266 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:31.510298 2252 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.510670 2089 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.513365 1385 catalog_manager.cc:5484] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.513476 1639 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.513373 1564 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.519821 1486 consensus_queue.cc:237] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:31.520853 2089 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.520927 1639 raft_consensus.cc:1261] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:31.521229 2252 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.521392 2266 consensus_queue.cc:1035] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:31.522614 2253 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.523064 1639 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.523730 2089 raft_consensus.cc:2932] T 351717c2aada4ff691742452820f96f6 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:31.524483 1371 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 351717c2aada4ff691742452820f96f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:31.524942 1382 catalog_manager.cc:5484] T 351717c2aada4ff691742452820f96f6 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:31.527295 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet 351717c2aada4ff691742452820f96f6 with delete_type TABLET_DATA_TOMBSTONED (TS 171fd27a77964e6588327f262ecffc39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48176
I20240503 08:01:31.527638 2280 tablet_replica.cc:330] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: stopping tablet replica
I20240503 08:01:31.527863 2280 raft_consensus.cc:2229] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:31.528030 2280 raft_consensus.cc:2258] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:31.528597 2280 ts_tablet_manager.cc:1875] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:31.530236 2280 ts_tablet_manager.cc:1888] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:31.530298 2280 log.cc:1196] T 351717c2aada4ff691742452820f96f6 P 171fd27a77964e6588327f262ecffc39: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root/wals/351717c2aada4ff691742452820f96f6
I20240503 08:01:31.530685 1369 catalog_manager.cc:4830] TS 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553): tablet 351717c2aada4ff691742452820f96f6 (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:32.536217 1486 consensus_queue.cc:237] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
W20240503 08:01:32.537549 1452 consensus_peers.cc:485] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb31c5818e7c45baacaf69e36a746fc7. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:32.537564 1563 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:32.537801 1637 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:32.537933 2282 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.538244 2253 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.539705 2266 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.540061 1637 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.540109 1563 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.542423 1486 consensus_queue.cc:237] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:32.542742 1385 catalog_manager.cc:5484] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.544026 1637 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:01:32.544092 1452 consensus_peers.cc:485] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c81a3f38a34cba88f04bc01c734427. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:32.544368 1564 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:32.544457 2282 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.544651 2266 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.546408 2282 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.547775 1564 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.549571 1564 consensus_queue.cc:237] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:32.549755 1383 catalog_manager.cc:5484] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:32.550191 1637 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
W20240503 08:01:32.551539 1528 consensus_peers.cc:485] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 480063e4cccc4173ad5a8d258ce204dc. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:32.551934 1637 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:32.551966 1486 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:32.552598 2251 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.552882 2195 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.554406 2251 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.555084 1486 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.556043 1637 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.556618 1382 catalog_manager.cc:5484] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:32.557111 1486 consensus_queue.cc:237] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:32.558400 1564 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:32.558437 1639 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:01:32.559185 1452 consensus_peers.cc:485] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad66f33efc3e4033a129c6063b8845ba. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:32.559284 2266 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.559576 2266 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:32.561255 2287 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.561606 1564 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.561612 1637 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.564427 1382 catalog_manager.cc:5484] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:32.989140 2299 ts_tablet_manager.cc:902] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:32.989699 2299 tablet_copy_client.cc:308] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.1:34409
I20240503 08:01:32.990193 1498 tablet_copy_service.cc:140] P 8f4fcb24282e423cb788be167a3540e7: Received BeginTabletCopySession request for tablet eb31c5818e7c45baacaf69e36a746fc7 from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:53416)
I20240503 08:01:32.990284 1498 tablet_copy_service.cc:161] P 8f4fcb24282e423cb788be167a3540e7: Beginning new tablet copy session on tablet eb31c5818e7c45baacaf69e36a746fc7 from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:53416: session id = 75aca704dc1c4b008958c9229a0bda65-eb31c5818e7c45baacaf69e36a746fc7
I20240503 08:01:32.991216 1498 tablet_copy_source_session.cc:205] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:32.991986 2299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb31c5818e7c45baacaf69e36a746fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:32.994046 2299 tablet_copy_client.cc:783] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:32.994186 2299 tablet_copy_client.cc:647] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:32.995122 2299 tablet_copy_client.cc:523] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:32.996466 2299 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:33.000382 2299 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:33.000612 2299 tablet_bootstrap.cc:492] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:33.000771 2299 ts_tablet_manager.cc:1367] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:01:33.001205 2299 raft_consensus.cc:348] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.001336 2299 raft_consensus.cc:729] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:33.001444 2299 consensus_queue.cc:260] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.001827 2299 ts_tablet_manager.cc:1398] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:01:33.002203 1498 tablet_copy_service.cc:342] P 8f4fcb24282e423cb788be167a3540e7: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-eb31c5818e7c45baacaf69e36a746fc7 received from {username='slave'} at 127.0.0.1:53416
I20240503 08:01:33.002276 1498 tablet_copy_service.cc:433] P 8f4fcb24282e423cb788be167a3540e7: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-eb31c5818e7c45baacaf69e36a746fc7 on tablet eb31c5818e7c45baacaf69e36a746fc7 with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:33.031468 2299 ts_tablet_manager.cc:902] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553)
I20240503 08:01:33.031955 2299 tablet_copy_client.cc:308] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.2:41553
I20240503 08:01:33.032313 1574 tablet_copy_service.cc:140] P 171fd27a77964e6588327f262ecffc39: Received BeginTabletCopySession request for tablet 480063e4cccc4173ad5a8d258ce204dc from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:48218)
I20240503 08:01:33.032405 1574 tablet_copy_service.cc:161] P 171fd27a77964e6588327f262ecffc39: Beginning new tablet copy session on tablet 480063e4cccc4173ad5a8d258ce204dc from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:48218: session id = 75aca704dc1c4b008958c9229a0bda65-480063e4cccc4173ad5a8d258ce204dc
I20240503 08:01:33.033273 1574 tablet_copy_source_session.cc:205] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:33.034034 2299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480063e4cccc4173ad5a8d258ce204dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:33.036190 2299 tablet_copy_client.cc:783] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:33.036324 2299 tablet_copy_client.cc:647] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:33.037263 2299 tablet_copy_client.cc:523] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:33.038462 2299 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:33.041999 2299 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:33.042196 2299 tablet_bootstrap.cc:492] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:33.042342 2299 ts_tablet_manager.cc:1367] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240503 08:01:33.042716 2299 raft_consensus.cc:348] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.042824 2299 raft_consensus.cc:729] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:33.042909 2299 consensus_queue.cc:260] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.043161 2299 ts_tablet_manager.cc:1398] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:33.043520 1574 tablet_copy_service.cc:342] P 171fd27a77964e6588327f262ecffc39: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-480063e4cccc4173ad5a8d258ce204dc received from {username='slave'} at 127.0.0.1:48218
I20240503 08:01:33.043587 1574 tablet_copy_service.cc:433] P 171fd27a77964e6588327f262ecffc39: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-480063e4cccc4173ad5a8d258ce204dc on tablet 480063e4cccc4173ad5a8d258ce204dc with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:33.062467 2299 ts_tablet_manager.cc:902] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:33.062945 2299 tablet_copy_client.cc:308] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.1:34409
I20240503 08:01:33.063318 1498 tablet_copy_service.cc:140] P 8f4fcb24282e423cb788be167a3540e7: Received BeginTabletCopySession request for tablet b6c81a3f38a34cba88f04bc01c734427 from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:53416)
I20240503 08:01:33.063410 1498 tablet_copy_service.cc:161] P 8f4fcb24282e423cb788be167a3540e7: Beginning new tablet copy session on tablet b6c81a3f38a34cba88f04bc01c734427 from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:53416: session id = 75aca704dc1c4b008958c9229a0bda65-b6c81a3f38a34cba88f04bc01c734427
I20240503 08:01:33.064415 1498 tablet_copy_source_session.cc:205] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:33.065135 2299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6c81a3f38a34cba88f04bc01c734427. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:33.067368 2299 tablet_copy_client.cc:783] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:33.067536 2299 tablet_copy_client.cc:647] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:33.068574 2299 tablet_copy_client.cc:523] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:33.069765 2299 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:33.072778 2299 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:33.072963 2299 tablet_bootstrap.cc:492] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:33.073101 2299 ts_tablet_manager.cc:1367] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20240503 08:01:33.073472 2299 raft_consensus.cc:348] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.073587 2299 raft_consensus.cc:729] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:33.073673 2299 consensus_queue.cc:260] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.073926 2299 ts_tablet_manager.cc:1398] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:01:33.074541 1498 tablet_copy_service.cc:342] P 8f4fcb24282e423cb788be167a3540e7: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-b6c81a3f38a34cba88f04bc01c734427 received from {username='slave'} at 127.0.0.1:53416
I20240503 08:01:33.074612 1498 tablet_copy_service.cc:433] P 8f4fcb24282e423cb788be167a3540e7: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-b6c81a3f38a34cba88f04bc01c734427 on tablet b6c81a3f38a34cba88f04bc01c734427 with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:33.138619 2299 ts_tablet_manager.cc:902] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409)
I20240503 08:01:33.139145 2299 tablet_copy_client.cc:308] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Beginning tablet copy session from remote peer at address 127.0.99.1:34409
I20240503 08:01:33.139524 1498 tablet_copy_service.cc:140] P 8f4fcb24282e423cb788be167a3540e7: Received BeginTabletCopySession request for tablet ad66f33efc3e4033a129c6063b8845ba from peer 75aca704dc1c4b008958c9229a0bda65 ({username='slave'} at 127.0.0.1:53416)
I20240503 08:01:33.139613 1498 tablet_copy_service.cc:161] P 8f4fcb24282e423cb788be167a3540e7: Beginning new tablet copy session on tablet ad66f33efc3e4033a129c6063b8845ba from peer 75aca704dc1c4b008958c9229a0bda65 at {username='slave'} at 127.0.0.1:53416: session id = 75aca704dc1c4b008958c9229a0bda65-ad66f33efc3e4033a129c6063b8845ba
I20240503 08:01:33.140373 1498 tablet_copy_source_session.cc:205] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:01:33.141079 2299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad66f33efc3e4033a129c6063b8845ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:01:33.143167 2299 tablet_copy_client.cc:783] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 0 data blocks...
I20240503 08:01:33.143313 2299 tablet_copy_client.cc:647] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Starting download of 1 WAL segments...
I20240503 08:01:33.144331 2299 tablet_copy_client.cc:523] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:01:33.145681 2299 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: Bootstrap starting.
I20240503 08:01:33.149231 2299 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:01:33.149451 2299 tablet_bootstrap.cc:492] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: Bootstrap complete.
I20240503 08:01:33.149600 2299 ts_tablet_manager.cc:1367] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:01:33.150032 2299 raft_consensus.cc:348] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.150141 2299 raft_consensus.cc:729] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75aca704dc1c4b008958c9229a0bda65, State: Initialized, Role: LEARNER
I20240503 08:01:33.150236 2299 consensus_queue.cc:260] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:33.150516 2299 ts_tablet_manager.cc:1398] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:01:33.150890 1498 tablet_copy_service.cc:342] P 8f4fcb24282e423cb788be167a3540e7: Request end of tablet copy session 75aca704dc1c4b008958c9229a0bda65-ad66f33efc3e4033a129c6063b8845ba received from {username='slave'} at 127.0.0.1:53416
I20240503 08:01:33.150961 1498 tablet_copy_service.cc:433] P 8f4fcb24282e423cb788be167a3540e7: ending tablet copy session 75aca704dc1c4b008958c9229a0bda65-ad66f33efc3e4033a129c6063b8845ba on tablet ad66f33efc3e4033a129c6063b8845ba with peer 75aca704dc1c4b008958c9229a0bda65
I20240503 08:01:33.501667 2089 raft_consensus.cc:1203] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:33.521696 2089 raft_consensus.cc:1203] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:33.531862 2089 raft_consensus.cc:1203] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:33.611231 2089 raft_consensus.cc:1203] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:01:33.992664 2287 raft_consensus.cc:1050] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:33.993093 2287 consensus_queue.cc:237] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:33.994310 2089 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:33.994372 1639 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:33.994590 1563 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:33.994886 2322 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:33.995054 2282 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:33.995353 2287 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:33.997215 2322 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:33.998976 1564 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.000355 1639 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.001164 1383 catalog_manager.cc:5484] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.003187 2089 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.007864 1486 consensus_queue.cc:237] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.008841 2089 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.009112 1639 raft_consensus.cc:1261] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.009150 2322 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.009687 2322 consensus_queue.cc:1035] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.010836 2287 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.011242 2089 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.011293 1639 raft_consensus.cc:2932] T b6c81a3f38a34cba88f04bc01c734427 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.013401 1371 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b6c81a3f38a34cba88f04bc01c734427 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:34.014082 1383 catalog_manager.cc:5484] T b6c81a3f38a34cba88f04bc01c734427 P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 171fd27a77964e6588327f262ecffc39 (127.0.99.2) evicted. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.016137 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet b6c81a3f38a34cba88f04bc01c734427 with delete_type TABLET_DATA_TOMBSTONED (TS 171fd27a77964e6588327f262ecffc39 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48176
I20240503 08:01:34.016510 2333 tablet_replica.cc:330] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: stopping tablet replica
I20240503 08:01:34.016693 2333 raft_consensus.cc:2229] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:34.016855 2333 raft_consensus.cc:2258] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:34.017398 2333 ts_tablet_manager.cc:1875] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:34.019595 2333 ts_tablet_manager.cc:1888] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:34.019665 2333 log.cc:1196] T b6c81a3f38a34cba88f04bc01c734427 P 171fd27a77964e6588327f262ecffc39: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-1-root/wals/b6c81a3f38a34cba88f04bc01c734427
I20240503 08:01:34.020085 1369 catalog_manager.cc:4830] TS 171fd27a77964e6588327f262ecffc39 (127.0.99.2:41553): tablet b6c81a3f38a34cba88f04bc01c734427 (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:34.096094 2325 raft_consensus.cc:1050] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:34.096556 2325 consensus_queue.cc:237] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.097937 2089 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.098037 1639 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.098307 2282 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.098358 1564 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.098482 2322 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.098629 2325 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.100626 2282 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.101209 1639 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.102260 1564 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.103412 2089 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.104540 1385 catalog_manager.cc:5484] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:34.107705 1488 consensus_queue.cc:237] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.108678 2089 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.108692 1564 raft_consensus.cc:1261] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.109032 2287 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.109202 2322 consensus_queue.cc:1035] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.110385 2287 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.110814 1564 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.111694 2089 raft_consensus.cc:2932] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.112323 2251 raft_consensus.cc:1050] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:34.112679 2251 consensus_queue.cc:237] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.113610 1384 catalog_manager.cc:5484] T eb31c5818e7c45baacaf69e36a746fc7 P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.113880 1639 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.114334 2338 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.114796 1486 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.115097 1371 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet eb31c5818e7c45baacaf69e36a746fc7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:34.116355 1629 tablet_service.cc:1514] Processing DeleteTablet for tablet eb31c5818e7c45baacaf69e36a746fc7 with delete_type TABLET_DATA_TOMBSTONED (TS 9f870be2d05c49bbab11db8ad76d6c89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47706
I20240503 08:01:34.116703 2343 tablet_replica.cc:330] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: stopping tablet replica
I20240503 08:01:34.116868 2343 raft_consensus.cc:2229] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:34.117043 2343 raft_consensus.cc:2258] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:34.117612 2343 ts_tablet_manager.cc:1875] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:34.118031 2338 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.118108 2089 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.118412 2338 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.120005 2341 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.120419 2343 ts_tablet_manager.cc:1888] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:34.120328 1488 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.120482 2343 log.cc:1196] T eb31c5818e7c45baacaf69e36a746fc7 P 9f870be2d05c49bbab11db8ad76d6c89: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root/wals/eb31c5818e7c45baacaf69e36a746fc7
I20240503 08:01:34.120941 1370 catalog_manager.cc:4830] TS 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): tablet eb31c5818e7c45baacaf69e36a746fc7 (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:34.122642 1639 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.122895 1382 catalog_manager.cc:5484] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.124249 2089 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.127902 1563 consensus_queue.cc:237] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.128877 2089 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.128918 1639 raft_consensus.cc:1261] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 171fd27a77964e6588327f262ecffc39: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.129251 2251 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.129411 2339 consensus_queue.cc:1035] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.130908 2338 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 171fd27a77964e6588327f262ecffc39 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.131134 2089 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.131922 1639 raft_consensus.cc:2932] T 480063e4cccc4173ad5a8d258ce204dc P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.133693 1369 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 480063e4cccc4173ad5a8d258ce204dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:34.133934 1383 catalog_manager.cc:5484] T 480063e4cccc4173ad5a8d258ce204dc P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1) evicted. New cstate: current_term: 1 leader_uuid: "171fd27a77964e6588327f262ecffc39" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.135076 2322 raft_consensus.cc:1050] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7: attempting to promote NON_VOTER 75aca704dc1c4b008958c9229a0bda65 to VOTER
I20240503 08:01:34.135510 2322 consensus_queue.cc:237] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.136344 1472 tablet_service.cc:1514] Processing DeleteTablet for tablet 480063e4cccc4173ad5a8d258ce204dc with delete_type TABLET_DATA_TOMBSTONED (TS 8f4fcb24282e423cb788be167a3540e7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53376
I20240503 08:01:34.137076 1563 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.137434 2325 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.138161 1639 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.138389 2089 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 LEARNER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:01:34.138585 2325 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.138762 2282 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:01:34.138830 2348 tablet_replica.cc:330] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: stopping tablet replica
I20240503 08:01:34.138973 2348 raft_consensus.cc:2229] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:34.139178 2348 raft_consensus.cc:2258] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:34.139957 2348 ts_tablet_manager.cc:1875] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:34.141064 2282 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.141451 2089 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.141960 1639 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.143486 1563 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.144434 1383 catalog_manager.cc:5484] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index 2 to 3, 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:01:34.146509 2348 ts_tablet_manager.cc:1888] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:34.146623 2348 log.cc:1196] T 480063e4cccc4173ad5a8d258ce204dc P 8f4fcb24282e423cb788be167a3540e7: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-0-root/wals/480063e4cccc4173ad5a8d258ce204dc
I20240503 08:01:34.147511 1488 consensus_queue.cc:237] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } }
I20240503 08:01:34.148486 2089 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.148577 1563 raft_consensus.cc:1261] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:01:34.148758 1371 catalog_manager.cc:4830] TS 8f4fcb24282e423cb788be167a3540e7 (127.0.99.1:34409): tablet 480063e4cccc4173ad5a8d258ce204dc (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:34.148902 2282 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.149062 2325 consensus_queue.cc:1035] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:01:34.150313 2282 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.151044 1563 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.151849 2089 raft_consensus.cc:2932] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.154036 1371 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ad66f33efc3e4033a129c6063b8845ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:01:34.154515 1384 catalog_manager.cc:5484] T ad66f33efc3e4033a129c6063b8845ba P 75aca704dc1c4b008958c9229a0bda65 reported cstate change: config changed from index 3 to 4, VOTER 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3) evicted. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: false } } }
I20240503 08:01:34.156913 1629 tablet_service.cc:1514] Processing DeleteTablet for tablet ad66f33efc3e4033a129c6063b8845ba with delete_type TABLET_DATA_TOMBSTONED (TS 9f870be2d05c49bbab11db8ad76d6c89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47706
I20240503 08:01:34.157097 2343 tablet_replica.cc:330] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: stopping tablet replica
I20240503 08:01:34.157238 2343 raft_consensus.cc:2229] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:01:34.157373 2343 raft_consensus.cc:2258] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:01:34.157907 2343 ts_tablet_manager.cc:1875] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:01:34.159524 2343 ts_tablet_manager.cc:1888] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:01:34.159582 2343 log.cc:1196] T ad66f33efc3e4033a129c6063b8845ba P 9f870be2d05c49bbab11db8ad76d6c89: Deleting WAL directory at /tmp/dist-test-taskp56LzW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723231444759-396-0/minicluster-data/ts-2-root/wals/ad66f33efc3e4033a129c6063b8845ba
I20240503 08:01:34.159982 1370 catalog_manager.cc:4830] TS 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627): tablet ad66f33efc3e4033a129c6063b8845ba (table test-workload [id=868d672af79a46b68dd9177096807175]) successfully deleted
I20240503 08:01:35.163722 1486 consensus_queue.cc:237] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:35.164883 1639 raft_consensus.cc:1261] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:35.164899 1563 raft_consensus.cc:1261] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:01:35.164961 1452 consensus_peers.cc:485] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39413e968c2548229bf4026e1c278d94. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:35.165234 2325 consensus_queue.cc:1035] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.165417 2353 consensus_queue.cc:1035] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.166949 2354 raft_consensus.cc:2932] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.167311 1639 raft_consensus.cc:2932] T 39413e968c2548229bf4026e1c278d94 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.167356 1563 raft_consensus.cc:2932] T 39413e968c2548229bf4026e1c278d94 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.169936 1639 consensus_queue.cc:237] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:35.170650 1382 catalog_manager.cc:5484] T 39413e968c2548229bf4026e1c278d94 P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:35.171196 1486 raft_consensus.cc:1261] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:01:35.171322 1603 consensus_peers.cc:485] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b0f89b5529d4d879ec7f408870b466a. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:35.171567 2323 consensus_queue.cc:1035] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.171824 1563 raft_consensus.cc:1261] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:35.172103 2323 consensus_queue.cc:1035] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.173211 2254 raft_consensus.cc:2932] T 2b0f89b5529d4d879ec7f408870b466a P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.173521 1486 raft_consensus.cc:2932] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.173851 1563 raft_consensus.cc:2932] T 2b0f89b5529d4d879ec7f408870b466a P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.176093 1486 consensus_queue.cc:237] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:35.177510 1639 raft_consensus.cc:1261] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:35.177565 1563 raft_consensus.cc:1261] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 8f4fcb24282e423cb788be167a3540e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:01:35.177847 1452 consensus_peers.cc:485] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58bd5a282529408ebde35305325417ce. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:35.177955 2325 consensus_queue.cc:1035] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.178694 2353 consensus_queue.cc:1035] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.178663 1385 catalog_manager.cc:5484] T 2b0f89b5529d4d879ec7f408870b466a P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } attrs { replace: true } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.180250 2354 raft_consensus.cc:2932] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.181358 1639 raft_consensus.cc:2932] T 58bd5a282529408ebde35305325417ce P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.182083 1563 raft_consensus.cc:2932] T 58bd5a282529408ebde35305325417ce P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.183706 1382 catalog_manager.cc:5484] T 58bd5a282529408ebde35305325417ce P 8f4fcb24282e423cb788be167a3540e7 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "8f4fcb24282e423cb788be167a3540e7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:35.184803 1639 consensus_queue.cc:237] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } }
I20240503 08:01:35.186049 1486 raft_consensus.cc:1261] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:35.186244 1564 raft_consensus.cc:1261] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Refusing update from remote peer 9f870be2d05c49bbab11db8ad76d6c89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:01:35.186444 2362 consensus_queue.cc:1035] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:01:35.186595 2254 consensus_queue.cc:1035] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:01:35.186853 1603 consensus_peers.cc:485] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 -> Peer 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4:45553): Couldn't send request to peer 75aca704dc1c4b008958c9229a0bda65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 160b79c11fcc46d79948b6e49888ec84. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:01:35.188174 2362 raft_consensus.cc:2932] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.188555 1563 raft_consensus.cc:2932] T 160b79c11fcc46d79948b6e49888ec84 P 171fd27a77964e6588327f262ecffc39 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.188737 1486 raft_consensus.cc:2932] T 160b79c11fcc46d79948b6e49888ec84 P 8f4fcb24282e423cb788be167a3540e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } } }
I20240503 08:01:35.190966 1385 catalog_manager.cc:5484] T 160b79c11fcc46d79948b6e49888ec84 P 9f870be2d05c49bbab11db8ad76d6c89 reported cstate change: config changed from index -1 to 2, NON_VOTER 75aca704dc1c4b008958c9229a0bda65 (127.0.99.4) added. New cstate: current_term: 1 leader_uuid: "9f870be2d05c49bbab11db8ad76d6c89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8f4fcb24282e423cb788be167a3540e7" member_type: VOTER last_known_addr { host: "127.0.99.1" port: 34409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "171fd27a77964e6588327f262ecffc39" member_type: VOTER last_known_addr { host: "127.0.99.2" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f870be2d05c49bbab11db8ad76d6c89" member_type: VOTER last_known_addr { host: "127.0.99.3" port: 37627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aca704dc1c4b008958c9229a0bda65" member_type: NON_VOTER last_known_addr { host: "127.0.99.4" port: 45553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:01:35.568869 2372 ts_tablet_manager.cc:902] T 2b0f89b5529d4d879ec7f408870b466a P 75aca704dc1c4b008958c9229a0bda65: Initiating tablet copy from peer 9f870be2d05c49bbab11db8ad76d6c89 (127.0.99.3:37627)
F20240503 08:01:35.569077 2372 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-2b0f89b5529d4d879ec7f408870b466a.queue_time_us, tablet-download-pool-2b0f89b5529d4d879ec7f408870b466a.queue_time_us) (tablet-download-pool-351717c2aada4ff691742452820f96f6.queue_time_us, tablet-download-pool-351717c2aada4ff691742452820f96f6.queue_time_us) (tablet-download-pool-351717c2aada4ff691742452820f96f6.run_cpu_time_us, tablet-download-pool-351717c2aada4ff691742452820f96f6.run_cpu_time_us) (tablet-download-pool-351717c2aada4ff691742452820f96f6.run_wall_time_us, tablet-download-pool-351717c2aada4ff691742452820f96f6.run_wall_time_us) (tablet-download-pool-480063e4cccc4173ad5a8d258ce204dc.queue_time_us, tablet-download-pool-480063e4cccc4173ad5a8d258ce204dc.queue_time_us) (tablet-download-pool-480063e4cccc4173ad5a8d258ce204dc.run_cpu_time_us, tablet-download-pool-480063e4cccc4173ad5a8d258ce204dc.run_cpu_time_us) (tablet-download-pool-480063e4cccc4173ad5a8d258ce204dc.run_wall_time_us, tablet-download-pool-480063e4cccc4173ad5a8d258ce204dc.run_wall_time_us) (tablet-download-pool-5f4e300297e84663bcb1b718bfe537ce.queue_time_us, tablet-download-pool-5f4e300297e84663bcb1b718bfe537ce.queue_time_us) (tablet-download-pool-5f4e300297e84663bcb1b718bfe537ce.run_cpu_time_us, tablet-download-pool-5f4e300297e84663bcb1b718bfe537ce.run_cpu_time_us) (tablet-download-pool-5f4e300297e84663bcb1b718bfe537ce.run_wall_time_us, tablet-download-pool-5f4e300297e84663bcb1b718bfe537ce.run_wall_time_us) (tablet-download-pool-8545dc5db5dd48fea2116afe19dd17c1.queue_time_us, tablet-download-pool-8545dc5db5dd48fea2116afe19dd17c1.queue_time_us) (tablet-download-pool-8545dc5db5dd48fea2116afe19dd17c1.run_cpu_time_us, tablet-download-pool-8545dc5db5dd48fea2116afe19dd17c1.run_cpu_time_us) (tablet-download-pool-8545dc5db5dd48fea2116afe19dd17c1.run_wall_time_us, tablet-download-pool-8545dc5db5dd48fea2116afe19dd17c1.run_wall_time_us) (tablet-download-pool-907a3bdbd3454c4b8381fd68330bc2a0.queue_time_us, tablet-download-pool-907a3bdbd3454c4b8381fd68330bc2a0.queue_time_us) (tablet-download-pool-907a3bdbd3454c4b8381fd68330bc2a0.run_cpu_time_us, tablet-download-pool-907a3bdbd3454c4b8381fd68330bc2a0.run_cpu_time_us) (tablet-download-pool-907a3bdbd3454c4b8381fd68330bc2a0.run_wall_time_us, tablet-download-pool-907a3bdbd3454c4b8381fd68330bc2a0.run_wall_time_us) (tablet-download-pool-9a053f3bfd984b82b2d6ea6e833e2245.queue_time_us, tablet-download-pool-9a053f3bfd984b82b2d6ea6e833e2245.queue_time_us) (tablet-download-pool-9a053f3bfd984b82b2d6ea6e833e2245.run_cpu_time_us, tablet-download-pool-9a053f3bfd984b82b2d6ea6e833e2245.run_cpu_time_us) (tablet-download-pool-9a053f3bfd984b82b2d6ea6e833e2245.run_wall_time_us, tablet-download-pool-9a053f3bfd984b82b2d6ea6e833e2245.run_wall_time_us) (tablet-download-pool-a64a657fff614834aabcb06e2197030b.queue_time_us, tablet-download-pool-a64a657fff614834aabcb06e2197030b.queue_time_us) (tablet-download-pool-a64a657fff614834aabcb06e2197030b.run_cpu_time_us, tablet-download-pool-a64a657fff614834aabcb06e2197030b.run_cpu_time_us) (tablet-download-pool-a64a657fff614834aabcb06e2197030b.run_wall_time_us, tablet-download-pool-a64a657fff614834aabcb06e2197030b.run_wall_time_us) (tablet-download-pool-ad66f33efc3e4033a129c6063b8845ba.queue_time_us, tablet-download-pool-ad66f33efc3e4033a129c6063b8845ba.queue_time_us) (tablet-download-pool-ad66f33efc3e4033a129c6063b8845ba.run_cpu_time_us, tablet-download-pool-ad66f33efc3e4033a129c6063b8845ba.run_cpu_time_us) (tablet-download-pool-ad66f33efc3e4033a129c6063b8845ba.run_wall_time_us, tablet-download-pool-ad66f33efc3e4033a129c6063b8845ba.run_wall_time_us) (tablet-download-pool-b6c81a3f38a34cba88f04bc01c734427.queue_time_us, tablet-download-pool-b6c81a3f38a34cba88f04bc01c734427.queue_time_us) (tablet-download-pool-b6c81a3f38a34cba88f04bc01c734427.run_cpu_time_us, tablet-download-pool-b6c81a3f38a34cba88f04bc01c734427.run_cpu_time_us) (tablet-download-pool-b6c81a3f38a34cba88f04bc01c734427.run_wall_time_us, tablet-download-pool-b6c81a3f38a34cba88f04bc01c734427.run_wall_time_us) (tablet-download-pool-c436d20ad34f455ea1ac00e72e2118fd.queue_time_us, tablet-download-pool-c436d20ad34f455ea1ac00e72e2118fd.queue_time_us) (tablet-download-pool-c436d20ad34f455ea1ac00e72e2118fd.run_cpu_time_us, tablet-download-pool-c436d20ad34f455ea1ac00e72e2118fd.run_cpu_time_us) (tablet-download-pool-c436d20ad34f455ea1ac00e72e2118fd.run_wall_time_us, tablet-download-pool-c436d20ad34f455ea1ac00e72e2118fd.run_wall_time_us) (tablet-download-pool-d3c8c6ca18ca47d18e3650e09dac28cc.queue_time_us, tablet-download-pool-d3c8c6ca18ca47d18e3650e09dac28cc.queue_time_us) (tablet-download-pool-d3c8c6ca18ca47d18e3650e09dac28cc.run_cpu_time_us, tablet-download-pool-d3c8c6ca18ca47d18e3650e09dac28cc.run_cpu_time_us) (tablet-download-pool-d3c8c6ca18ca47d18e3650e09dac28cc.run_wall_time_us, tablet-download-pool-d3c8c6ca18ca47d18e3650e09dac28cc.run_wall_time_us) (tablet-download-pool-eb31c5818e7c45baacaf69e36a746fc7.queue_time_us, tablet-download-pool-eb31c5818e7c45baacaf69e36a746fc7.queue_time_us) (tablet-download-pool-eb31c5818e7c45baacaf69e36a746fc7.run_cpu_time_us, tablet-download-pool-eb31c5818e7c45baacaf69e36a746fc7.run_cpu_time_us) (tablet-download-pool-eb31c5818e7c45baacaf69e36a746fc7.run_wall_time_us, tablet-download-pool-eb31c5818e7c45baacaf69e36a746fc7.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714723295 (unix time) try "date -d @1714723295" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000018c) received by PID 396 (TID 0x7fa4671fe700) from PID 396; stack trace: ***
@ 0x7fa50ab26980 (unknown) at ??:0
@ 0x7fa5085f6fb7 gsignal at ??:0
@ 0x7fa5085f8921 abort at ??:0
@ 0x7fa509801dcd google::LogMessage::Fail() at ??:0
@ 0x7fa509805b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fa5098017cc google::LogMessage::Flush() at ??:0
@ 0x7fa509802f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa50a359044 kudu::TraceMetrics::InternName() at ??:0
@ 0x7fa50a33df98 kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7fa50a33befc kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7fa50b44177a kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7fa50b44aa45 kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7fa50b4cb76f kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7fa50b4df4f6 kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7fa50b4ca226 _ZZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS_6StatusENS0_24TabletServerErrorPB_CodeEEEENKUlvE_clEv at ??:0
@ 0x7fa50b4d9c0a _ZNSt17_Function_handlerIFvvEZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS1_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS1_6StatusENS2_24TabletServerErrorPB_CodeEEEEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fa50ba343cc std::function<>::operator()() at ??:0
@ 0x7fa50a340e06 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa50a3416ef _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fa50a34303b _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fa50ba343cc std::function<>::operator()() at ??:0
@ 0x7fa50a330807 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa50ab1b6db start_thread at ??:0
@ 0x7fa5086d971f clone at ??:0